Nov 14 01:59:33 user devstack@n-api.service[64865]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 14 01:59:33 user devstack@n-api.service[64865]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Nov 14 01:59:33 2023] *** Nov 14 01:59:33 user devstack@n-api.service[64865]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Nov 14 01:59:33 user devstack@n-api.service[64865]: os: Linux-5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 Nov 14 01:59:33 user devstack@n-api.service[64865]: nodename: user Nov 14 01:59:33 user devstack@n-api.service[64865]: machine: x86_64 Nov 14 01:59:33 user devstack@n-api.service[64865]: clock source: unix Nov 14 01:59:33 user devstack@n-api.service[64865]: pcre jit disabled Nov 14 01:59:33 user devstack@n-api.service[64865]: detected number of CPU cores: 12 Nov 14 01:59:33 user devstack@n-api.service[64865]: current working directory: / Nov 14 01:59:33 user devstack@n-api.service[64865]: detected binary path: /usr/bin/uwsgi-core Nov 14 01:59:33 user devstack@n-api.service[64865]: your processes number limit is 63589 Nov 14 01:59:33 user devstack@n-api.service[64865]: your memory page size is 4096 bytes Nov 14 01:59:33 user devstack@n-api.service[64865]: detected max file descriptor number: 2048 Nov 14 01:59:33 user devstack@n-api.service[64865]: lock engine: pthread robust mutexes Nov 14 01:59:33 user devstack@n-api.service[64865]: thunder lock: enabled Nov 14 01:59:33 user devstack@n-api.service[64865]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 14 01:59:33 user devstack@n-api.service[64865]: Python version: 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] Nov 14 01:59:33 user devstack@n-api.service[64865]: PEP 405 virtualenv detected: /opt/stack/data/venv Nov 14 01:59:33 user devstack@n-api.service[64865]: Set PythonHome to /opt/stack/data/venv Nov 14 01:59:33 user devstack@n-api.service[64865]: Python main interpreter initialized at 0x561e181f3b90 Nov 14 01:59:33 user devstack@n-api.service[64865]: python threads support enabled Nov 14 01:59:33 user devstack@n-api.service[64865]: your server socket listen backlog is limited to 100 connections Nov 14 01:59:33 user devstack@n-api.service[64865]: your mercy for graceful operations on workers is 80 seconds Nov 14 01:59:33 user devstack@n-api.service[64865]: mapped 537436 bytes (524 KB) for 3 cores Nov 14 01:59:33 user devstack@n-api.service[64865]: *** Operational MODE: preforking *** Nov 14 01:59:33 user devstack@n-api.service[64865]: *** uWSGI is running in multiple interpreter mode *** Nov 14 01:59:33 user devstack@n-api.service[64865]: spawned uWSGI master process (pid: 64865) Nov 14 01:59:33 user devstack@n-api.service[64865]: spawned uWSGI worker 1 (pid: 64866, cores: 1) Nov 14 01:59:33 user devstack@n-api.service[64865]: spawned uWSGI worker 2 (pid: 64867, cores: 1) Nov 14 01:59:33 user devstack@n-api.service[64865]: spawned uWSGI worker 3 (pid: 64868, cores: 1) Nov 14 01:59:33 user devstack@n-api.service[64865]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 14 01:59:37 user devstack@n-api.service[64866]: live_migration_uri is deprecated for removal in favor of two other options that Nov 14 01:59:37 user devstack@n-api.service[64866]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 14 01:59:37 user devstack@n-api.service[64866]: and ``live_migration_inbound_addr`` respectively. Nov 14 01:59:37 user devstack@n-api.service[64866]: ). Its value may be silently ignored in the future. Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 14 01:59:37 user devstack@n-api.service[64867]: live_migration_uri is deprecated for removal in favor of two other options that Nov 14 01:59:37 user devstack@n-api.service[64867]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 14 01:59:37 user devstack@n-api.service[64867]: and ``live_migration_inbound_addr`` respectively. Nov 14 01:59:37 user devstack@n-api.service[64867]: ). Its value may be silently ignored in the future. Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64866) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64867) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: INFO dbcounter [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Registered counter for database nova_api Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: INFO dbcounter [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Registered counter for database nova_api Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_db.sqlalchemy.engines [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_db.sqlalchemy.engines [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writer thread running {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writer thread running {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG nova.context [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff922a0f-fbdc-4dd7-ba91-19419fe3fa47(cell1) {{(pid=64867) load_cells /opt/stack/nova/nova/context.py:464}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG nova.context [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff922a0f-fbdc-4dd7-ba91-19419fe3fa47(cell1) {{(pid=64866) load_cells /opt/stack/nova/nova/context.py:464}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 01:59:37 user devstack@n-api.service[64868]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: INFO dbcounter [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Registered counter for database nova_cell0 Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: INFO dbcounter [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Registered counter for database nova_cell0 Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: INFO dbcounter [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Registered counter for database nova_cell1 Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: INFO dbcounter [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Registered counter for database nova_cell1 Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 14 01:59:37 user devstack@n-api.service[64868]: live_migration_uri is deprecated for removal in favor of two other options that Nov 14 01:59:37 user devstack@n-api.service[64868]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 14 01:59:37 user devstack@n-api.service[64868]: and ``live_migration_inbound_addr`` respectively. Nov 14 01:59:37 user devstack@n-api.service[64868]: ). Its value may be silently ignored in the future. Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_db.sqlalchemy.engines [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writer thread running {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_db.sqlalchemy.engines [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_db.sqlalchemy.engines [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writer thread running {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writer thread running {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_db.sqlalchemy.engines [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writer thread running {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64867]: INFO dbcounter [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Registered counter for database nova_cell0 Nov 14 01:59:37 user devstack@n-api.service[64866]: INFO dbcounter [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Registered counter for database nova_cell0 Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG oslo_db.sqlalchemy.engines [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writer thread running {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG oslo_db.sqlalchemy.engines [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writer thread running {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64868]: INFO dbcounter [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Registered counter for database nova_api Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writer thread running {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG nova.context [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff922a0f-fbdc-4dd7-ba91-19419fe3fa47(cell1) {{(pid=64868) load_cells /opt/stack/nova/nova/context.py:464}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 01:59:37 user devstack@n-api.service[64868]: INFO dbcounter [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Registered counter for database nova_cell0 Nov 14 01:59:37 user devstack@n-api.service[64868]: INFO dbcounter [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Registered counter for database nova_cell1 Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writer thread running {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writer thread running {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64867]: WARNING keystonemiddleware.auth_token [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 14 01:59:37 user devstack@n-api.service[64867]: WARNING keystonemiddleware.auth_token [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 14 01:59:37 user devstack@n-api.service[64868]: INFO dbcounter [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Registered counter for database nova_cell0 Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 14 01:59:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writer thread running {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 14 01:59:37 user devstack@n-api.service[64866]: WARNING keystonemiddleware.auth_token [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 14 01:59:37 user devstack@n-api.service[64866]: WARNING keystonemiddleware.auth_token [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 14 01:59:38 user devstack@n-api.service[64867]: WARNING keystonemiddleware.auth_token [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 14 01:59:38 user devstack@n-api.service[64866]: WARNING keystonemiddleware.auth_token [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 14 01:59:38 user devstack@n-api.service[64867]: WARNING keystonemiddleware.auth_token [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 14 01:59:38 user devstack@n-api.service[64866]: WARNING keystonemiddleware.auth_token [None req-807de4a2-bfa1-42f6-b580-ce63a4c8de7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 14 01:59:38 user devstack@n-api.service[64867]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e181f3b90 pid: 64867 (default app) Nov 14 01:59:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 01:59:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001486 Nov 14 01:59:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Nov 14 01:59:38 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 01:59:38 user devstack@n-api.service[64866]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e181f3b90 pid: 64866 (default app) Nov 14 01:59:38 user devstack@n-api.service[64868]: WARNING keystonemiddleware.auth_token [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 14 01:59:38 user devstack@n-api.service[64868]: WARNING keystonemiddleware.auth_token [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 14 01:59:38 user devstack@n-api.service[64868]: WARNING keystonemiddleware.auth_token [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 14 01:59:38 user devstack@n-api.service[64868]: WARNING keystonemiddleware.auth_token [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 14 01:59:38 user devstack@n-api.service[64868]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e181f3b90 pid: 64868 (default app) Nov 14 02:01:46 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b183ce10-4f81-469b-bdf1-4dfda9518898 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001735 Nov 14 02:01:46 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:01:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:01:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f0cffb20-64bc-4b18-b8fe-0351d269ecfe admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f0cffb20-64bc-4b18-b8fe-0351d269ecfe admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.207732 Nov 14 02:01:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 14 02:01:46 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:01:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002461 Nov 14 02:01:48 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:01:48 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:01:48 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:48 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:48 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:48 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:01:48 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5fa7c4aa-9f55-4c30-ac2f-a296112ba083 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5fa7c4aa-9f55-4c30-ac2f-a296112ba083 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.223875 Nov 14 02:01:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:01:48 2023] POST /compute/v2.1/flavors => generated 405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:01:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0bb2d8ad-5855-4a3e-b6ab-2edf76efe1ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0bb2d8ad-5855-4a3e-b6ab-2edf76efe1ff admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058792 Nov 14 02:01:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 14 02:01:48 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:01:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001327 Nov 14 02:01:51 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:01:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:01:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-cc60a515-7944-4104-90b9-7fc6f02a54fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "disk": 5, "vcpus": 1, "name": "ds512M", "ram": 512}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-cc60a515-7944-4104-90b9-7fc6f02a54fb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.023000 Nov 14 02:01:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:01:51 2023] POST /compute/v2.1/flavors => generated 402 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:01:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-3e87c079-0e15-48e0-a209-ca5b3ca70f50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-3e87c079-0e15-48e0-a209-ca5b3ca70f50 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031080 Nov 14 02:01:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 14 02:01:51 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:01:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001323 Nov 14 02:01:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:01:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:01:53 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-082bb47a-366f-4f93-8f93-aad3309326e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "swap": 0}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-082bb47a-366f-4f93-8f93-aad3309326e3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.019317 Nov 14 02:01:53 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:01:53 2023] POST /compute/v2.1/flavors => generated 402 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:01:53 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-19be7a42-fe5f-4f1f-b58e-e783b9a49814 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-19be7a42-fe5f-4f1f-b58e-e783b9a49814 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050763 Nov 14 02:01:53 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 14 02:01:53 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:01:55 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:55 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001323 Nov 14 02:01:55 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:01:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:01:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a23a28c1-e827-4de2-b9a3-35bcaffbbe28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a23a28c1-e827-4de2-b9a3-35bcaffbbe28 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.019403 Nov 14 02:01:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:01:55 2023] POST /compute/v2.1/flavors => generated 402 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:01:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-fba59a44-83a8-441d-b20f-f05c9c6240fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-fba59a44-83a8-441d-b20f-f05c9c6240fa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032553 Nov 14 02:01:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 14 02:01:55 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:01:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001398 Nov 14 02:01:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:01:57 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:01:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8c66a2c2-34ad-40be-961c-03c16931df56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "id": "d4", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8c66a2c2-34ad-40be-961c-03c16931df56 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.020537 Nov 14 02:01:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:01:57 2023] POST /compute/v2.1/flavors => generated 402 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:01:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:01:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024037 Nov 14 02:01:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 14 02:01:57 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:01:59 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bc7765e9-b556-48b2-8de8-5e1c64df68a5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001311 Nov 14 02:01:59 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:01:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:01:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-42d32d93-828e-476a-bfac-cfc11efa31e2 admin admin] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:01:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-42d32d93-828e-476a-bfac-cfc11efa31e2 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.029866 Nov 14 02:01:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 14 02:01:59 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:02:01 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:02:01 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002193 Nov 14 02:02:01 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:02:01 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:02:01 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:02:01 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:02:01 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:02:01 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:02:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a432f7bd-7e4a-4998-af29-5f76ff50fbf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a432f7bd-7e4a-4998-af29-5f76ff50fbf6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.214176 Nov 14 02:02:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:02:01 2023] POST /compute/v2.1/flavors => generated 400 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:02:01 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-232765e9-12b3-4765-bd78-800a1d3d24a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-232765e9-12b3-4765-bd78-800a1d3d24a0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042212 Nov 14 02:02:01 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 14 02:02:01 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:02:03 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:02:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001297 Nov 14 02:02:03 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:02:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:02:03 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d8265264-b48f-4c60-90fd-19118cbfed44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "id": "2"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d8265264-b48f-4c60-90fd-19118cbfed44 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.021354 Nov 14 02:02:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:02:03 2023] POST /compute/v2.1/flavors => generated 403 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:02:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-cad78c94-797a-41f8-a1b9-14039f9697e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-cad78c94-797a-41f8-a1b9-14039f9697e4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028149 Nov 14 02:02:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 14 02:02:03 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:02:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:02:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001346 Nov 14 02:02:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:02:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:02:05 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fffc36fd-db41-42c7-91e1-858efeb74505 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:05 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fffc36fd-db41-42c7-91e1-858efeb74505 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.019130 Nov 14 02:02:05 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:02:05 2023] POST /compute/v2.1/flavors => generated 404 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:02:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-60ec7a3b-8001-4b7c-9f8c-c1f9d44a67be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-60ec7a3b-8001-4b7c-9f8c-c1f9d44a67be admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023837 Nov 14 02:02:05 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 14 02:02:05 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:02:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:02:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001355 Nov 14 02:02:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:02:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:02:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-91498d8a-707f-40b4-9ce3-359a6a50154e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-91498d8a-707f-40b4-9ce3-359a6a50154e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.019821 Nov 14 02:02:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:02:07 2023] POST /compute/v2.1/flavors => generated 403 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:02:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b920f6af-f416-4f68-bf99-3407e44311ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b920f6af-f416-4f68-bf99-3407e44311ac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025546 Nov 14 02:02:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 14 02:02:07 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:02:09 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:02:09 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001405 Nov 14 02:02:09 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 14 02:02:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:02:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-33520d23-a50e-415c-bb50-0f6e770a7cd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "ram": 16384}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-33520d23-a50e-415c-bb50-0f6e770a7cd2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.020464 Nov 14 02:02:09 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 14 02:02:09 2023] POST /compute/v2.1/flavors => generated 406 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:02:09 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f26768cb-9696-4a5c-9310-ac445368bca8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:02:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f26768cb-9696-4a5c-9310-ac445368bca8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024145 Nov 14 02:02:09 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 14 02:02:09 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:02:42 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:02:42 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd5edbf1-72bc-4ab5-aed0-e7f576f3a6c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001503 Nov 14 02:02:42 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 14 02:02:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:02:42 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:02:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.083811 Nov 14 02:02:42 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1389 bytes} [Tue Nov 14 02:02:42 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 14 02:03:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f26768cb-9696-4a5c-9310-ac445368bca8 admin admin] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:03:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f26768cb-9696-4a5c-9310-ac445368bca8 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001503 Nov 14 02:03:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 14 02:03:11 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:03:11 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:03:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-360c2f49-2eef-4f80-b5b5-f3d7341231df admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:03:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-360c2f49-2eef-4f80-b5b5-f3d7341231df admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.028651 Nov 14 02:03:11 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1368 bytes} [Tue Nov 14 02:03:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:03:14 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:03:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-711b9497-6014-4bf4-8428-472d5921b47b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001457 Nov 14 02:03:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 14 02:03:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:03:14 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:03:14 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7fd050ec-8fcd-4a0b-873d-9fe5611122bc admin admin] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:03:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7fd050ec-8fcd-4a0b-873d-9fe5611122bc admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 424 microversion: 2.61 time: 0.017380 Nov 14 02:03:14 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 15/41] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 14 02:03:14 2023] GET /compute/v2.1/flavors/1 => generated 424 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:03:16 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-360c2f49-2eef-4f80-b5b5-f3d7341231df admin admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:03:16 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-360c2f49-2eef-4f80-b5b5-f3d7341231df admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002582 Nov 14 02:03:16 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 14/42] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 14 02:03:16 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:03:16 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:03:16 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:03:16 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:03:16 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ebde3e3c-5ac7-473d-8504-2a19388a617d admin admin] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:03:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ebde3e3c-5ac7-473d-8504-2a19388a617d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/2" status: 200 len: 427 microversion: 2.61 time: 0.023814 Nov 14 02:03:16 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 14/43] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 14 02:03:16 2023] GET /compute/v2.1/flavors/2 => generated 427 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:05:33 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:05:33 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3b81f734-aedc-4c69-a2b5-181dad0e08d1 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec3cfc70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-97172499"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-3b81f734-aedc-4c69-a2b5-181dad0e08d1 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.282887 Nov 14 02:05:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 16/44] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Nov 14 02:05:33 2023] POST /compute/v2.1/os-volumes => generated 343 bytes in 1288 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 14 02:05:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ec267225-cd08-4898-a405-b461044e4187 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec382f80>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-ec267225-cd08-4898-a405-b461044e4187 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 200 len: 343 microversion: 2.1 time: 0.322112 Nov 14 02:05:34 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 15/45] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:05:34 2023] GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 343 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:35 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:05:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7e1baa7b-1bc6-413d-9d71-cb3a2869a114 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec2a1240>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7e1baa7b-1bc6-413d-9d71-cb3a2869a114 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 200 len: 344 microversion: 2.1 time: 0.272631 Nov 14 02:05:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 15/46] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:05:35 2023] GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 344 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ca25d42d-066a-40a9-98bd-751f5b91e895 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec2d88b0>, body: {"snapshot": {"volume_id": "536d1728-2b0a-4e33-a390-7dee702b9665", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1693390887"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ca25d42d-066a-40a9-98bd-751f5b91e895 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.250466 Nov 14 02:05:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Nov 14 02:05:35 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-40c89270-25d2-4a4a-a40a-357f9849410d tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec383250>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-40c89270-25d2-4a4a-a40a-357f9849410d tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188" status: 200 len: 287 microversion: 2.1 time: 0.081835 Nov 14 02:05:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 14 02:05:36 2023] GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-17c68c88-a34f-4db8-bd78-138115243ed3 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9eccc3a30>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-17c68c88-a34f-4db8-bd78-138115243ed3 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.054164 Nov 14 02:05:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 14 02:05:36 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7a9c5fd5-8b49-4b3a-bab4-37aa2a3a45ad tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec141c60>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7a9c5fd5-8b49-4b3a-bab4-37aa2a3a45ad tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188" status: 200 len: 287 microversion: 2.1 time: 0.063903 Nov 14 02:05:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 14 02:05:36 2023] GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b4f5a8b8-c0db-4b3c-a643-0ce080f9b5af tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec100b80>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b4f5a8b8-c0db-4b3c-a643-0ce080f9b5af tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188" status: 200 len: 288 microversion: 2.1 time: 0.039256 Nov 14 02:05:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 14 02:05:37 2023] GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1164839d-e273-4209-a0ee-35438fd91eda tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9eccc3be0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1164839d-e273-4209-a0ee-35438fd91eda tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188" status: 202 len: 0 microversion: 2.1 time: 0.090617 Nov 14 02:05:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 14 02:05:37 2023] DELETE /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:05:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7058f28a-235e-466a-a3e9-f7cd70ab657e tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec141d80>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7058f28a-235e-466a-a3e9-f7cd70ab657e tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188" status: 200 len: 287 microversion: 2.1 time: 0.040082 Nov 14 02:05:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 14 02:05:37 2023] GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0bc348b1-2532-45d5-92f9-bfdfea99fbef tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec101000>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-0bc348b1-2532-45d5-92f9-bfdfea99fbef tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] HTTP exception thrown: Snapshot d5a234c8-6082-419b-817a-9608bad30188 could not be found. Nov 14 02:05:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0bc348b1-2532-45d5-92f9-bfdfea99fbef tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Returning 404 to user: Snapshot d5a234c8-6082-419b-817a-9608bad30188 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:05:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0bc348b1-2532-45d5-92f9-bfdfea99fbef tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188" status: 404 len: 111 microversion: 2.1 time: 0.029232 Nov 14 02:05:38 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 14 02:05:38 2023] GET /compute/v2.1/os-snapshots/d5a234c8-6082-419b-817a-9608bad30188 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:05:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-69507649-278e-4b68-a2fe-227735375d76 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec137ac0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-69507649-278e-4b68-a2fe-227735375d76 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 202 len: 0 microversion: 2.1 time: 0.106054 Nov 14 02:05:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:05:38 2023] DELETE /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:05:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-27b96b33-c63c-46d6-9204-dcd46b14b9a8 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec141750>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-27b96b33-c63c-46d6-9204-dcd46b14b9a8 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 200 len: 343 microversion: 2.1 time: 0.052617 Nov 14 02:05:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:05:38 2023] GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 343 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:39 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1151ea2d-3662-430c-bfa4-54f36ccd26f8 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec100ee0>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1151ea2d-3662-430c-bfa4-54f36ccd26f8 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 200 len: 343 microversion: 2.1 time: 0.059281 Nov 14 02:05:39 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:05:39 2023] GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 343 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-35e3f9e8-0f3a-4e92-85a9-5fd4ef16a162 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec137370>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-35e3f9e8-0f3a-4e92-85a9-5fd4ef16a162 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] HTTP exception thrown: Volume 536d1728-2b0a-4e33-a390-7dee702b9665 could not be found. Nov 14 02:05:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-35e3f9e8-0f3a-4e92-85a9-5fd4ef16a162 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Returning 404 to user: Volume 536d1728-2b0a-4e33-a390-7dee702b9665 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:05:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-35e3f9e8-0f3a-4e92-85a9-5fd4ef16a162 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 404 len: 109 microversion: 2.1 time: 0.033891 Nov 14 02:05:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:05:40 2023] GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:05:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-76bbdd23-20b2-44a2-abb6-e8205d8e6183 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec142170>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-76bbdd23-20b2-44a2-abb6-e8205d8e6183 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] HTTP exception thrown: Volume 536d1728-2b0a-4e33-a390-7dee702b9665 could not be found. Nov 14 02:05:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-76bbdd23-20b2-44a2-abb6-e8205d8e6183 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Returning 404 to user: Volume 536d1728-2b0a-4e33-a390-7dee702b9665 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:05:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-76bbdd23-20b2-44a2-abb6-e8205d8e6183 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 404 len: 109 microversion: 2.1 time: 0.031096 Nov 14 02:05:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:05:40 2023] DELETE /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:05:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7f635de2-9006-4ef8-812c-735b060fed91 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Calling method '.version_select at 0x7fc9ec100a60>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-7f635de2-9006-4ef8-812c-735b060fed91 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] HTTP exception thrown: Volume 536d1728-2b0a-4e33-a390-7dee702b9665 could not be found. Nov 14 02:05:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7f635de2-9006-4ef8-812c-735b060fed91 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] Returning 404 to user: Volume 536d1728-2b0a-4e33-a390-7dee702b9665 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:05:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7f635de2-9006-4ef8-812c-735b060fed91 tempest-VolumesSnapshotsTestJSON-992273876 tempest-VolumesSnapshotsTestJSON-992273876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665" status: 404 len: 109 microversion: 2.1 time: 0.035368 Nov 14 02:05:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:05:41 2023] GET /compute/v2.1/os-volumes/536d1728-2b0a-4e33-a390-7dee702b9665 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 14 02:05:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0728eb5b-155f-4103-902a-5a24ad86939e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec137250>, body: {"keypair": {"name": "tempest-keypair-1627475945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:47 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-0728eb5b-155f-4103-902a-5a24ad86939e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for project a1ba9547629f4ea1b40424e277e17d25. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:47 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-0728eb5b-155f-4103-902a-5a24ad86939e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for user 7ffa5574e531479993ef301510f1d9e3 and project a1ba9547629f4ea1b40424e277e17d25. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0728eb5b-155f-4103-902a-5a24ad86939e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.410222 Nov 14 02:05:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:05:47 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:48 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ed946562-ba49-4ea1-9373-25bfda2d6907 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Action: 'create', calling method: .version_select at 0x7fc9ecccf910>, body: {"keypair": {"name": "tempest-keypair-1863826463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq7oRF6OXXfz/US7S5M/p/e15didQje182FxTBE9gXxDXx7o0EBCTENzobqIRSryWT181xbmOLIIMJAJVc0DG69fsUd13H6dI+0Clcf6sFNLQBtvOE6JrQMPFfhuLmNrg=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:48 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-ed946562-ba49-4ea1-9373-25bfda2d6907 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Getting quotas for project 3c82a8c1198544448e57221af68aa01e. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:48 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-ed946562-ba49-4ea1-9373-25bfda2d6907 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Getting quotas for user 684b5b76244349489205840fb9b4e39d and project 3c82a8c1198544448e57221af68aa01e. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ed946562-ba49-4ea1-9373-25bfda2d6907 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124501 Nov 14 02:05:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 22/62] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:05:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:49 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:05:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-062fb443-e514-4e7d-a275-5e48e5f53cfc tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec383250>, body: {"keypair": {"name": "tempest-keypair-94073184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:49 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-062fb443-e514-4e7d-a275-5e48e5f53cfc tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:49 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-062fb443-e514-4e7d-a275-5e48e5f53cfc tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for user 4002c20dcbc94a8ea540419f20f8621e and project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-062fb443-e514-4e7d-a275-5e48e5f53cfc tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.340620 Nov 14 02:05:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:05:49 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:05:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-42747156", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "0ce4ee69-8517-419c-a70e-bfa199241285"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:52 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] validate_networks() for [('0ce4ee69-8517-419c-a70e-bfa199241285', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:05:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1271828340", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "f3895747-ee7e-46a0-8759-2a4f3e01b728"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-437502509", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "2e565fc0-c932-4f99-84ef-b157a352b43c"}], "security_groups": [{"name": "tempest-securitygroup--1661447046"}], "key_name": "tempest-keypair-94073184", "user_data": "}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:52 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] validate_networks() for [('f3895747-ee7e-46a0-8759-2a4f3e01b728', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:05:53 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] validate_networks() for [('2e565fc0-c932-4f99-84ef-b157a352b43c', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Getting quotas for project be0fe3e87f6d484f8f205662dcc31a4b. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Getting quotas for user 5ca1c02f69824ccabfbf9ada3f202403 and project be0fe3e87f6d484f8f205662dcc31a4b. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:05:53 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:05:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.939540 Nov 14 02:05:54 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:05:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:05:54 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-510afd24-86a8-46d2-ae78-ad575a9d0a15 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec1d9a20>, body: {"keypair": {"name": "tempest-keypair-586767792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgf2fXbCY9rsjb34KMUST8SMXto50nACORXEnnMj+K0J2fgBaFnj6x23XOrkc5PvkSbOH/DwnZ6aLyMOr4VrPPGI6VOba5H/JsmvGMycdDB8yWuFuzI/QXeNX4GuWC8IA=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for user 4002c20dcbc94a8ea540419f20f8621e and project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:54 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-510afd24-86a8-46d2-ae78-ad575a9d0a15 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting quotas for project 91262b32dbc949beb98767d004ff9a73. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:54 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-510afd24-86a8-46d2-ae78-ad575a9d0a15 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting quotas for user 67156afa3d24427e90e99f944362ecfe and project 91262b32dbc949beb98767d004ff9a73. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Getting quotas for project df2958ade8524b6e9c245384d7fe9b92. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Getting quotas for user 1bf2a54e5cb84e16b3218e3ca1f2fbdc and project df2958ade8524b6e9c245384d7fe9b92. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:05:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-510afd24-86a8-46d2-ae78-ad575a9d0a15 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.93 time: 0.377023 Nov 14 02:05:54 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 22/65] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 14 02:05:54 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 379 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:05:54 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-1338652237", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "dc8c6c51-2843-43f4-95cf-8e873f067676"}], "security_groups": [{"name": "tempest-securitygroup--246424804"}], "key_name": "tempest-keypair-1627475945", "user_data": "}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.696058 Nov 14 02:05:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:05:52 2023] POST /compute/v2.1/servers => generated 400 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f8b8b418-6192-45f4-8492-49a9c97da167 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f8b8b418-6192-45f4-8492-49a9c97da167 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:05:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.854717 Nov 14 02:05:54 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:05:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3294f139-e597-4ab1-9a1c-95124a041201 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-3294f139-e597-4ab1-9a1c-95124a041201 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-f8b8b418-6192-45f4-8492-49a9c97da167 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca1c02f69824ccabfbf9ada3f202403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fe3e87f6d484f8f205662dcc31a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:05:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f8b8b418-6192-45f4-8492-49a9c97da167 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" status: 200 len: 1205 microversion: 2.1 time: 0.232595 Nov 14 02:05:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:05:54 2023] GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba => generated 1205 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b1cb7fe3-8f9f-425c-9298-8a98296bd86f tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b1cb7fe3-8f9f-425c-9298-8a98296bd86f tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b1cb7fe3-8f9f-425c-9298-8a98296bd86f tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:05:54 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-3294f139-e597-4ab1-9a1c-95124a041201 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:05:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b1cb7fe3-8f9f-425c-9298-8a98296bd86f tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 200 len: 1209 microversion: 2.1 time: 0.131262 Nov 14 02:05:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 24/69] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:05:54 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 1209 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:05:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-3294f139-e597-4ab1-9a1c-95124a041201 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1227 microversion: 2.1 time: 0.316976 Nov 14 02:05:54 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 24/70] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:05:54 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1227 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:05:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1579375628", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "5919d81b-1969-4559-82b3-6497f0571caa"}], "security_groups": [{"name": "tempest-securitygroup--1488168713"}], "key_name": "tempest-keypair-1863826463", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:05:54 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] validate_networks() for [('dc8c6c51-2843-43f4-95cf-8e873f067676', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] validate_networks() for [('5919d81b-1969-4559-82b3-6497f0571caa', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Getting quotas for project 3c82a8c1198544448e57221af68aa01e. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Getting quotas for user 684b5b76244349489205840fb9b4e39d and project 3c82a8c1198544448e57221af68aa01e. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:05:55 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:05:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.088059 Nov 14 02:05:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:05:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:05:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-dbec0db4-8744-4fba-b9b3-940d0f4db4c0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:55 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-dbec0db4-8744-4fba-b9b3-940d0f4db4c0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:05:56 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-dbec0db4-8744-4fba-b9b3-940d0f4db4c0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:05:56 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-dbec0db4-8744-4fba-b9b3-940d0f4db4c0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 200 len: 1238 microversion: 2.1 time: 0.121188 Nov 14 02:05:56 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 25/72] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:05:55 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 1238 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for user 7ffa5574e531479993ef301510f1d9e3 and project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:05:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:05:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.917533 Nov 14 02:05:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 23/73] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:05:54 2023] POST /compute/v2.1/servers => generated 406 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:05:56 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b010c3d4-c456-42ca-8753-b4420c90d6e2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:05:56 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b010c3d4-c456-42ca-8753-b4420c90d6e2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:05:56 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b010c3d4-c456-42ca-8753-b4420c90d6e2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:05:56 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b010c3d4-c456-42ca-8753-b4420c90d6e2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1233 microversion: 2.1 time: 0.137960 Nov 14 02:05:56 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 26/74] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:05:56 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1233 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Creating event network-changed:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64867) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Acquired lock "compute-rpcapi-router" {{(pid=64867) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:02 user devstack@n-api.service[64867]: INFO nova.compute.rpcapi [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 14 02:06:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] Releasing lock "compute-rpcapi-router" {{(pid=64867) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 14 02:06:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f18d49bb-e83f-4001-b601-8312e21b1d79 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240684 Nov 14 02:06:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba", "tag": "57b1674a-e229-46ea-ba3e-2b8d57a9b518"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Creating event network-changed:57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba on user Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=64868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:02 user devstack@n-api.service[64868]: INFO nova.compute.rpcapi [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 14 02:06:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] Releasing lock "compute-rpcapi-router" {{(pid=64868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 14 02:06:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-26fc6c55-0fad-475c-b352-fa39481b725d None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157305 Nov 14 02:06:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 24/76] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Creating event network-changed:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64866) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Acquired lock "compute-rpcapi-router" {{(pid=64866) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:04 user devstack@n-api.service[64866]: INFO nova.compute.rpcapi [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 14 02:06:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] Releasing lock "compute-rpcapi-router" {{(pid=64866) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 14 02:06:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-cde2097b-486b-4574-ac5c-c3f8c2b3969d None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084378 Nov 14 02:06:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9df98c-7814-419d-8821-d8c571972f0e", "tag": "592113b0-b777-4a01-ac6c-d5337e7d773a"}, {"name": "network-changed", "server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Creating event network-changed:592113b0-b777-4a01-ac6c-d5337e7d773a for instance 2f9df98c-7814-419d-8821-d8c571972f0e on user Nov 14 02:06:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Creating event network-changed:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:06:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042299 Nov 14 02:06:04 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:07 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=20 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-aa9e4d50-f4ac-4935-8262-ca321d41daca tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec08e320>, body: {"keypair": {"name": "tempest-keypair-1368640699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5+yRFEwVQWprnc7ODmeU3bQAwpnqUHzc+F/OioFpEEeae7IQXrZGHZi/lqSuBGwTYoGQL/HLDn56SDAvFoatTPDJemQy33iCCPDbGw0rxPRWy558FvMow3jTEevbrLpw=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:07 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-aa9e4d50-f4ac-4935-8262-ca321d41daca tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting quotas for project 2b4120a890b64ac9abb385f0ba8d3447. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:07 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-aa9e4d50-f4ac-4935-8262-ca321d41daca tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting quotas for user 9e4dbe6bba744f4cabba17fcbea21c64 and project 2b4120a890b64ac9abb385f0ba8d3447. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-aa9e4d50-f4ac-4935-8262-ca321d41daca tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.272114 Nov 14 02:06:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 25/79] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:06:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:08 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=22 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-316cdb07-2bc0-4202-bdf2-880303160a8e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec046200>, body: {"keypair": {"name": "tempest-keypair-1154414656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhj4EaeRXfb9NhMQegYPjT/0/LNAZQJ+nyOpv1nCt/fNC2YFkT+WEza0vNVeLKvgisEvUQ1Ac56JE3n49AToodAUPgrNFxkJM6n2fLECVtuDKkZ5iI820bK1yg2l6tSHQ=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:08 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-316cdb07-2bc0-4202-bdf2-880303160a8e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Getting quotas for project 05fe8be09f614bfcb6ea1bfc3adef743. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:08 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-316cdb07-2bc0-4202-bdf2-880303160a8e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Getting quotas for user 6812b41d5b0f4a35b22dec35cd0d44c6 and project 05fe8be09f614bfcb6ea1bfc3adef743. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-316cdb07-2bc0-4202-bdf2-880303160a8e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202908 Nov 14 02:06:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 28/80] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:06:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=14 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1824193926", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9"}], "security_groups": [{"name": "tempest-securitygroup--1797406777"}], "key_name": "tempest-keypair-1368640699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] validate_networks() for [('18e0a90a-04a6-4a06-b7d2-6cb6b68906b9', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting quotas for project 2b4120a890b64ac9abb385f0ba8d3447. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting quotas for user 9e4dbe6bba744f4cabba17fcbea21c64 and project 2b4120a890b64ac9abb385f0ba8d3447. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:06:09 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:06:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.619467 Nov 14 02:06:09 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 28/81] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:06:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:06:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-51958ed2-4241-4b20-932a-3b6d626426ee tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:09 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-51958ed2-4241-4b20-932a-3b6d626426ee tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:10 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-51958ed2-4241-4b20-932a-3b6d626426ee tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-51958ed2-4241-4b20-932a-3b6d626426ee tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd" status: 200 len: 1234 microversion: 2.1 time: 0.346448 Nov 14 02:06:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 26/82] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:09 2023] GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd => generated 1234 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1645257739", "imageRef": "2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "b8a8607b-2c76-4094-9b20-0a1a967b52ef"}], "security_groups": [{"name": "tempest-securitygroup--1921271675"}], "key_name": "tempest-keypair-1154414656", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] validate_networks() for [('b8a8607b-2c76-4094-9b20-0a1a967b52ef', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Getting quotas for project 05fe8be09f614bfcb6ea1bfc3adef743. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Getting quotas for user 6812b41d5b0f4a35b22dec35cd0d44c6 and project 05fe8be09f614bfcb6ea1bfc3adef743. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:06:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:06:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.709562 Nov 14 02:06:11 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 29/83] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:06:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:06:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7d22c071-f80a-409f-a5d3-e2fe5907ab7e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7d22c071-f80a-409f-a5d3-e2fe5907ab7e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:11 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7d22c071-f80a-409f-a5d3-e2fe5907ab7e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6812b41d5b0f4a35b22dec35cd0d44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fe8be09f614bfcb6ea1bfc3adef743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7d22c071-f80a-409f-a5d3-e2fe5907ab7e tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1" status: 200 len: 1238 microversion: 2.1 time: 0.094882 Nov 14 02:06:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 29/84] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:11 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1 => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-046f5d04-9b95-4b49-a140-481acbfa1448 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec08f1c0>, body: {"keypair": {"name": "tempest-keypair-1715447766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:12 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-046f5d04-9b95-4b49-a140-481acbfa1448 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Getting quotas for project fe096d58b812473296c75ad5d3d5c924. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:12 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-046f5d04-9b95-4b49-a140-481acbfa1448 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Getting quotas for user 3ca1d05e84d74c1ab74521dcc91f3f38 and project fe096d58b812473296c75ad5d3d5c924. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-046f5d04-9b95-4b49-a140-481acbfa1448 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.047565 Nov 14 02:06:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 27/85] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 14 02:06:12 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:06:13 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba", "name": "network-vif-plugged", "status": "completed", "tag": "57b1674a-e229-46ea-ba3e-2b8d57a9b518"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Creating event network-vif-plugged:57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba on user Nov 14 02:06:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041219 Nov 14 02:06:13 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6f0bc298-d936-4b9a-b96e-9c7e1bbc8a55 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec043400>, body: {"keypair": {"name": "tempest-keypair-1172015827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGic6H0CdbSyqWBGVsfiHfK2deh7upIvHfskva2vI9QFGjB0wM99ch4Bmnjjiz/IbnT0KpD62foVYAD+LVpz8dcQuiZCCKbwh3weEBJ4wNafEgEQnWVVxhuPeAEf4PASQ=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:13 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-6f0bc298-d936-4b9a-b96e-9c7e1bbc8a55 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Getting quotas for project da668843b57c40ee9f230c5912bb2709. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:13 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-6f0bc298-d936-4b9a-b96e-9c7e1bbc8a55 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Getting quotas for user 90a4a3f1b20246e3b1e50bbd76a498fd and project da668843b57c40ee9f230c5912bb2709. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6f0bc298-d936-4b9a-b96e-9c7e1bbc8a55 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.379687 Nov 14 02:06:14 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 30/87] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:06:13 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:14 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:14 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=8 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:14 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1053798230", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "92fc7073-a06d-44ea-bb1b-c86ace99eec2"}], "security_groups": [{"name": "tempest-securitygroup--1896345554"}], "key_name": "tempest-keypair-1715447766", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:14 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] validate_networks() for [('92fc7073-a06d-44ea-bb1b-c86ace99eec2', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:06:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba", "name": "network-vif-plugged", "status": "completed", "tag": "57b1674a-e229-46ea-ba3e-2b8d57a9b518"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Creating event network-vif-plugged:57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba on user Nov 14 02:06:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101061 Nov 14 02:06:15 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 31/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Getting quotas for project fe096d58b812473296c75ad5d3d5c924. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Getting quotas for user 3ca1d05e84d74c1ab74521dcc91f3f38 and project fe096d58b812473296c75ad5d3d5c924. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:06:16 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:06:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.695833 Nov 14 02:06:16 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 28/89] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:06:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:06:16 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f8bebc2a-2315-4b92-beda-74a21297af89 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:16 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f8bebc2a-2315-4b92-beda-74a21297af89 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:17 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-f8bebc2a-2315-4b92-beda-74a21297af89 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:17 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-f8bebc2a-2315-4b92-beda-74a21297af89 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:17 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-f8bebc2a-2315-4b92-beda-74a21297af89 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f8bebc2a-2315-4b92-beda-74a21297af89 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 200 len: 1321 microversion: 2.49 time: 0.851287 Nov 14 02:06:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 31/90] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:06:16 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 1321 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:06:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "name": "network-vif-plugged", "status": "completed", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Creating event network-vif-plugged:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:06:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056302 Nov 14 02:06:18 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 32/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAssistedSnapshotsTest-server-1913356881", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "70e9fb82-e77b-420b-90ec-b92382c04f69"}], "security_groups": [{"name": "tempest-securitygroup--266765855"}], "key_name": "tempest-keypair-1172015827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:19 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] validate_networks() for [('70e9fb82-e77b-420b-90ec-b92382c04f69', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:06:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd62b270-19d7-45e5-bd66-a94c384050bd", "tag": "aa2867e8-4cfe-415e-96a1-881199b73c4c"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=10 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:20 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "name": "network-vif-plugged", "status": "completed", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}, {"name": "network-changed", "server_uuid": "0bbd75fc-a135-4bc6-8853-e28dfc6219c1", "tag": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf"}, {"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Creating event network-changed:aa2867e8-4cfe-415e-96a1-881199b73c4c for instance fd62b270-19d7-45e5-bd66-a94c384050bd on user Nov 14 02:06:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560744 Nov 14 02:06:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:06:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:06:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:06:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:06:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:06:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Creating event network-vif-plugged:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:06:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Creating event network-changed:e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 on user Nov 14 02:06:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:06:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.155378 Nov 14 02:06:20 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 33/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:20 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Getting quotas for project da668843b57c40ee9f230c5912bb2709. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Getting quotas for user 90a4a3f1b20246e3b1e50bbd76a498fd and project da668843b57c40ee9f230c5912bb2709. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:06:21 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:06:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.947431 Nov 14 02:06:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 29/94] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:06:19 2023] POST /compute/v2.1/servers => generated 403 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:06:21 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7fbf876d-a30f-4548-a85b-28e2956e7a95 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:21 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7fbf876d-a30f-4548-a85b-28e2956e7a95 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:21 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7fbf876d-a30f-4548-a85b-28e2956e7a95 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a4a3f1b20246e3b1e50bbd76a498fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da668843b57c40ee9f230c5912bb2709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7fbf876d-a30f-4548-a85b-28e2956e7a95 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05" status: 200 len: 1238 microversion: 2.1 time: 0.222309 Nov 14 02:06:21 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 33/95] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:21 2023] GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05 => generated 1238 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:23 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:23 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=10 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:23 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:23 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:06:23 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076076 Nov 14 02:06:23 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 34/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:25 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsV293TestJSON-server-830117018", "imageRef": "", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "a89fe182-db5c-45d7-bf99-4b62526465e6"}], "security_groups": [{"name": "tempest-securitygroup--1577956404"}], "key_name": "tempest-keypair-586767792", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "63a8b1e6-4579-48f6-8a4c-b75386826ce7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, ": true}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:25 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}, {"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:06:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:06:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113706 Nov 14 02:06:25 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 34/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:25 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] validate_networks() for [('a89fe182-db5c-45d7-bf99-4b62526465e6', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting quotas for project 91262b32dbc949beb98767d004ff9a73. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting quotas for user 67156afa3d24427e90e99f944362ecfe and project 91262b32dbc949beb98767d004ff9a73. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:06:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63a8b1e6-4579-48f6-8a4c-b75386826ce7',volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:06:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.93 time: 1.736684 Nov 14 02:06:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 30/98] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:06:25 2023] POST /compute/v2.1/servers => generated 407 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:06:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bfea18dc-d9df-4f81-a690-89c4072c0c56 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:26 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-bfea18dc-d9df-4f81-a690-89c4072c0c56 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:27 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-bfea18dc-d9df-4f81-a690-89c4072c0c56 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:27 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-bfea18dc-d9df-4f81-a690-89c4072c0c56 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:27 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-bfea18dc-d9df-4f81-a690-89c4072c0c56 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bfea18dc-d9df-4f81-a690-89c4072c0c56 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 200 len: 1331 microversion: 2.93 time: 0.163307 Nov 14 02:06:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 35/99] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:06:26 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:06:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd62b270-19d7-45e5-bd66-a94c384050bd", "name": "network-vif-plugged", "status": "completed", "tag": "aa2867e8-4cfe-415e-96a1-881199b73c4c"}, {"server_uuid": "fd62b270-19d7-45e5-bd66-a94c384050bd", "name": "network-vif-plugged", "status": "completed", "tag": "aa2867e8-4cfe-415e-96a1-881199b73c4c"}, {"name": "network-changed", "server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Creating event network-vif-plugged:aa2867e8-4cfe-415e-96a1-881199b73c4c for instance fd62b270-19d7-45e5-bd66-a94c384050bd on user Nov 14 02:06:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Creating event network-vif-plugged:aa2867e8-4cfe-415e-96a1-881199b73c4c for instance fd62b270-19d7-45e5-bd66-a94c384050bd on user Nov 14 02:06:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Creating event network-changed:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:06:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.071890 Nov 14 02:06:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 35/100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1326183-c4cb-40fa-a352-470e2c69cb05", "tag": "fb5f3206-b474-4ff1-b22a-ec6169264796"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Creating event network-changed:fb5f3206-b474-4ff1-b22a-ec6169264796 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 on user Nov 14 02:06:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130380 Nov 14 02:06:27 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 31/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd75fc-a135-4bc6-8853-e28dfc6219c1", "name": "network-vif-plugged", "status": "completed", "tag": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Creating event network-vif-plugged:e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 on user Nov 14 02:06:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082479 Nov 14 02:06:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 36/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:31 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=16 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:31 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd75fc-a135-4bc6-8853-e28dfc6219c1", "name": "network-vif-plugged", "status": "completed", "tag": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Creating event network-vif-plugged:e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 on user Nov 14 02:06:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102771 Nov 14 02:06:31 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 36/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1326183-c4cb-40fa-a352-470e2c69cb05", "name": "network-vif-plugged", "status": "completed", "tag": "fb5f3206-b474-4ff1-b22a-ec6169264796"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Creating event network-vif-plugged:fb5f3206-b474-4ff1-b22a-ec6169264796 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 on user Nov 14 02:06:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113686 Nov 14 02:06:32 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 32/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}, {"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1326183-c4cb-40fa-a352-470e2c69cb05", "name": "network-vif-plugged", "status": "completed", "tag": "fb5f3206-b474-4ff1-b22a-ec6169264796"}, {"name": "network-changed", "server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Creating event network-vif-plugged:fb5f3206-b474-4ff1-b22a-ec6169264796 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 on user Nov 14 02:06:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Creating event network-changed:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:06:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.196979 Nov 14 02:06:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 37/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:34 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Creating event network-vif-plugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:06:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Creating event network-vif-plugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:06:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.548286 Nov 14 02:06:34 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 37/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=28 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=127,nova_api:INSERT=19 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=10 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-plugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Creating event network-vif-plugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:06:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139042 Nov 14 02:06:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 33/107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=10 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=101,nova_api:INSERT=11 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=24 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:45 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-01611749-bc94-4a08-a1ac-1e134846ca2f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1533 microversion: 2.1 time: 0.525096 Nov 14 02:06:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 34/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:44 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1533 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:06:45 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d1cb7d87-a877-4f1d-8861-b12deb5d9607 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 200 len: 1492 microversion: 2.1 time: 0.652185 Nov 14 02:06:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 38/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:44 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 1492 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:45 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca1c02f69824ccabfbf9ada3f202403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fe3e87f6d484f8f205662dcc31a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-267bd10b-396e-4455-bc7d-4851a24b5049 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" status: 200 len: 1486 microversion: 2.1 time: 1.190957 Nov 14 02:06:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 38/110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:44 2023] GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba => generated 1486 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-plugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Creating event network-vif-plugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:06:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150603 Nov 14 02:06:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 35/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:46 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-9b980a7e-ad02-4c88-937a-23f98c22b3aa tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 200 len: 1552 microversion: 2.1 time: 0.258789 Nov 14 02:06:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 39/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:46 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 1552 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:46 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:06:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-61d341bc-a72b-4765-a7b2-51be9660fed8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1541 microversion: 2.1 time: 0.260655 Nov 14 02:06:46 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 39/113] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:06:46 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1541 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:06:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9df98c-7814-419d-8821-d8c571972f0e", "name": "network-vif-plugged", "status": "completed", "tag": "592113b0-b777-4a01-ac6c-d5337e7d773a"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Creating event network-vif-plugged:592113b0-b777-4a01-ac6c-d5337e7d773a for instance 2f9df98c-7814-419d-8821-d8c571972f0e on user Nov 14 02:06:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166536 Nov 14 02:06:48 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 36/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:06:50 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9df98c-7814-419d-8821-d8c571972f0e", "name": "network-vif-plugged", "status": "completed", "tag": "592113b0-b777-4a01-ac6c-d5337e7d773a"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:06:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:06:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:06:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:06:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Creating event network-vif-plugged:592113b0-b777-4a01-ac6c-d5337e7d773a for instance 2f9df98c-7814-419d-8821-d8c571972f0e on user Nov 14 02:06:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044025 Nov 14 02:06:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 40/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:06:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=12 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:00 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:00 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-57170b1f-4f17-4430-80df-9bfc983c2fd5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd" status: 200 len: 1544 microversion: 2.1 time: 0.251381 Nov 14 02:07:00 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 40/116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:00 2023] GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=8 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=12 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:02 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6812b41d5b0f4a35b22dec35cd0d44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fe8be09f614bfcb6ea1bfc3adef743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-793fd2d2-de47-42d2-8178-f8fda343668c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1" status: 200 len: 1547 microversion: 2.1 time: 0.435170 Nov 14 02:07:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 37/117] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:01 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1 => generated 1547 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=14 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:07 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bd614a1b-a7dc-40c7-9ec2-0bc96a3e0593 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 200 len: 1629 microversion: 2.49 time: 0.263752 Nov 14 02:07:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 41/118] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:07:07 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 1629 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:11 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a4a3f1b20246e3b1e50bbd76a498fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da668843b57c40ee9f230c5912bb2709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-4f91e48f-7484-4cdd-8392-b400479153b1 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05" status: 200 len: 1551 microversion: 2.1 time: 0.255624 Nov 14 02:07:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 41/119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:11 2023] GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05 => generated 1551 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:17 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-348a759c-6ea9-49f0-af3c-63149950f6ce tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 200 len: 1719 microversion: 2.93 time: 0.449466 Nov 14 02:07:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 38/120] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:07:17 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 1719 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a97104bc-ac48-4302-b80f-3fe18d8b62d3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.181686 Nov 14 02:07:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1101070144", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "f3895747-ee7e-46a0-8759-2a4f3e01b728"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:07:45 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-interface => generated 282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:45 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:45 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:45 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] validate_networks() for [('f3895747-ee7e-46a0-8759-2a4f3e01b728', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-e442e88d-add5-4acc-aea5-7d539eeda290 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.193984 Nov 14 02:07:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 39/122] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:07:46 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-interface => generated 282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Getting quotas for project df2958ade8524b6e9c245384d7fe9b92. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Getting quotas for user 1bf2a54e5cb84e16b3218e3ca1f2fbdc and project df2958ade8524b6e9c245384d7fe9b92. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:07:46 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.240570 Nov 14 02:07:46 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 42/123] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:07:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-decdbac3-a5ee-4136-9f6e-c7eb848887be tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-decdbac3-a5ee-4136-9f6e-c7eb848887be tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:47 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-decdbac3-a5ee-4136-9f6e-c7eb848887be tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-decdbac3-a5ee-4136-9f6e-c7eb848887be tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19" status: 200 len: 1209 microversion: 2.1 time: 0.084261 Nov 14 02:07:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 40/124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:46 2023] GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c6e3cef0-87e5-4cb6-8447-75c5d0c2ee1a tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec043130>, body: {"keypair": {"name": "tempest-keypair-309882152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLTqWumKP5WLuDxvDcPlc4017G4UnwfFpm58ymfDNqIIv4mmT7uWp6VUwoXAw4ASrN05TZ0JaBF1S4zNfqxHQpdOoaI/VdjQ0yhIPt3PxWX2JXh2URVHKy0oiWfxltLOA=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-c6e3cef0-87e5-4cb6-8447-75c5d0c2ee1a tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Getting quotas for project 5778b17ddccd4d7d82adbc420ad6adc0. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-c6e3cef0-87e5-4cb6-8447-75c5d0c2ee1a tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Getting quotas for user 83c1fd3efa9a4997be00910265484154 and project 5778b17ddccd4d7d82adbc420ad6adc0. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:07:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c6e3cef0-87e5-4cb6-8447-75c5d0c2ee1a tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060492 Nov 14 02:07:47 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 43/125] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:07:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-762b1812-e991-4593-8223-e4adf6304e07 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.279543 Nov 14 02:07:47 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 43/126] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:07:46 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/os-interface => generated 282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67d3d4c4-83a2-43e0-ab0a-b532171bf9c3"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Creating event network-changed:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:07:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053787 Nov 14 02:07:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 41/127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-fe8e797a-5d5b-422e-8b42-bc7611dd6967 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/ips" status: 200 len: 104 microversion: 2.1 time: 0.037257 Nov 14 02:07:47 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 44/128] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:07:47 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/ips => generated 104 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604777 Nov 14 02:07:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 44/129] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:07:47 2023] POST /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Creating event network-changed:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:07:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038262 Nov 14 02:07:48 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 42/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-775307858"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:48 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachmentScenario-server-2071366743", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "ccc94fe2-6b16-46cd-8221-521a9b2cf069"}], "security_groups": [{"name": "tempest-securitygroup--1144990670"}], "key_name": "tempest-keypair-309882152", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:48 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] validate_networks() for [('ccc94fe2-6b16-46cd-8221-521a9b2cf069', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0a3524b9-7ff4-4048-a3e7-6d7eeaea4eba tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1541 microversion: 2.1 time: 0.378614 Nov 14 02:07:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:48 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1541 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/action" status: 202 len: 0 microversion: 2.1 time: 1.236617 Nov 14 02:07:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 45/132] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:07:48 2023] POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/action => generated 0 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "399fd6d1-cc6f-432c-96c2-eb97da1c0ceb"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-5897dff6-b581-4808-99d2-4f1ecf101962 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1541 microversion: 2.1 time: 0.182587 Nov 14 02:07:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:49 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1541 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-96263a3c-8763-48f1-83ac-58a231a358f7 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '.version_select at 0x7fc9ec0e36d0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-96263a3c-8763-48f1-83ac-58a231a358f7 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239" status: 200 len: 1610 microversion: 2.1 time: 0.059714 Nov 14 02:07:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 45/134] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 14 02:07:49 2023] GET /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239 => generated 1610 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Creating event network-changed:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Getting quotas for project 5778b17ddccd4d7d82adbc420ad6adc0. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Getting quotas for user 83c1fd3efa9a4997be00910265484154 and project 5778b17ddccd4d7d82adbc420ad6adc0. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:07:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036764 Nov 14 02:07:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:07:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:07:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.909950 Nov 14 02:07:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 45/136] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:07:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3725e92d-60e3-48f9-87e8-11b24737b548 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3725e92d-60e3-48f9-87e8-11b24737b548 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:49 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3725e92d-60e3-48f9-87e8-11b24737b548 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c1fd3efa9a4997be00910265484154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b17ddccd4d7d82adbc420ad6adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3725e92d-60e3-48f9-87e8-11b24737b548 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb" status: 200 len: 1243 microversion: 2.1 time: 0.086549 Nov 14 02:07:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 47/137] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:49 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399245 Nov 14 02:07:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 46/138] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:07:49 2023] POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:50 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b950c25e-2910-4de3-a9fc-30e4091dfe19", "tag": "3ec017bb-c846-419e-a33f-860b071d3b18"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:50 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Creating event network-changed:3ec017bb-c846-419e-a33f-860b071d3b18 for instance b950c25e-2910-4de3-a9fc-30e4091dfe19 on user Nov 14 02:07:50 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037450 Nov 14 02:07:50 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b950c25e-2910-4de3-a9fc-30e4091dfe19", "name": "network-vif-plugged", "status": "completed", "tag": "3ec017bb-c846-419e-a33f-860b071d3b18"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Creating event network-vif-plugged:3ec017bb-c846-419e-a33f-860b071d3b18 for instance b950c25e-2910-4de3-a9fc-30e4091dfe19 on user Nov 14 02:07:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Nov 14 02:07:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6df88a-5599-4b10-917c-c3c0b009c3cb", "tag": "7946fb64-2722-4b7d-a7bc-5223ad6536e5"}, {"server_uuid": "b950c25e-2910-4de3-a9fc-30e4091dfe19", "name": "network-vif-plugged", "status": "completed", "tag": "3ec017bb-c846-419e-a33f-860b071d3b18"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Creating event network-changed:7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb on user Nov 14 02:07:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Creating event network-vif-plugged:3ec017bb-c846-419e-a33f-860b071d3b18 for instance b950c25e-2910-4de3-a9fc-30e4091dfe19 on user Nov 14 02:07:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039835 Nov 14 02:07:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:07:56 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6df88a-5599-4b10-917c-c3c0b009c3cb", "name": "network-vif-plugged", "status": "completed", "tag": "7946fb64-2722-4b7d-a7bc-5223ad6536e5"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:56 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Creating event network-vif-plugged:7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb on user Nov 14 02:07:56 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061280 Nov 14 02:07:56 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:07:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" status: 204 len: 0 microversion: 2.1 time: 0.176279 Nov 14 02:07:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 49/143] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:07:56 2023] DELETE /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:57 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca1c02f69824ccabfbf9ada3f202403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fe3e87f6d484f8f205662dcc31a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-88457bae-952d-4141-857c-f190bf1415a1 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" status: 200 len: 1538 microversion: 2.1 time: 0.318848 Nov 14 02:07:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:57 2023] GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba => generated 1538 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:57 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Going to try to stop instance {{(pid=64867) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 14 02:07:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action" status: 202 len: 0 microversion: 2.1 time: 0.154238 Nov 14 02:07:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 48/145] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:07:57 2023] POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:57 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:07:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c6f11bc1-3c1e-421c-a963-e351733c029c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1708 microversion: 2.1 time: 0.267268 Nov 14 02:07:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 50/146] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:07:57 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1708 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:07:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-unplugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Creating event network-vif-unplugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:07:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049921 Nov 14 02:07:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 49/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:07:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6df88a-5599-4b10-917c-c3c0b009c3cb", "name": "network-vif-plugged", "status": "completed", "tag": "7946fb64-2722-4b7d-a7bc-5223ad6536e5"}, {"server_uuid": "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba", "name": "network-vif-unplugged", "status": "completed", "tag": "57b1674a-e229-46ea-ba3e-2b8d57a9b518"}, {"server_uuid": "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba", "name": "network-vif-plugged", "status": "completed", "tag": "57b1674a-e229-46ea-ba3e-2b8d57a9b518"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:07:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:07:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:07:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:07:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Creating event network-vif-plugged:7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb on user Nov 14 02:07:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Creating event network-vif-unplugged:57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba on user Nov 14 02:07:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Creating event network-vif-plugged:57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba on user Nov 14 02:07:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.053720 Nov 14 02:07:58 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:07:58 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:00 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:00 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}, {"server_uuid": "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba", "name": "network-vif-deleted", "tag": "57b1674a-e229-46ea-ba3e-2b8d57a9b518"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:00 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:08:00 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Creating event network-vif-deleted:57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba on user Nov 14 02:08:00 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044813 Nov 14 02:08:00 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 51/149] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d0a5dbcb-2025-43a8-bc83-56240b0bd8d0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.164358 Nov 14 02:08:00 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:08:00 2023] GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-interface => generated 283 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:01 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:01 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=16 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:01 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd62b270-19d7-45e5-bd66-a94c384050bd", "tag": "aa2867e8-4cfe-415e-96a1-881199b73c4c"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Creating event network-changed:aa2867e8-4cfe-415e-96a1-881199b73c4c for instance fd62b270-19d7-45e5-bd66-a94c384050bd on user Nov 14 02:08:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038958 Nov 14 02:08:01 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3087b53f-b68d-4f66-9ff5-133152344607 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.185675 Nov 14 02:08:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 52/152] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:08:02 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-interface => generated 282 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c867f218-68b6-44eb-bf84-2d3e1644eeb2"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292452 Nov 14 02:08:03 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 51/153] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:08:03 2023] POST /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbd75fc-a135-4bc6-8853-e28dfc6219c1", "tag": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Creating event network-changed:e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 on user Nov 14 02:08:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042054 Nov 14 02:08:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bf11fc4-8a29-4374-b194-5c840e14fd7b"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:05 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326411 Nov 14 02:08:05 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 53/155] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:08:04 2023] POST /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5e60b00d-9ef2-409a-8636-f513be583191 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.178378 Nov 14 02:08:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 52/156] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:08:07 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-interface => generated 283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:08:08 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Creating event network-changed:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:08:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085218 Nov 14 02:08:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 52/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:09 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:09 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:09 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-927ba6f2-bbab-46c8-8d87-4e1397486216 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 200 len: 1629 microversion: 2.49 time: 0.301836 Nov 14 02:08:09 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 54/158] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:08:08 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 1629 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "tag": "nic-tag"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "tag": "07b9ece5-ed71-42e9-ae00-72829af206e8"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Creating event network-changed:07b9ece5-ed71-42e9-ae00-72829af206e8 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:08:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045635 Nov 14 02:08:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ef1b3f73-dd9b-4942-a10b-9f4e0202b10e"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] HTTP exception thrown: Volume ef1b3f73-dd9b-4942-a10b-9f4e0202b10e could not be found. Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Returning 400 to user: Volume ef1b3f73-dd9b-4942-a10b-9f4e0202b10e could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:08:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-941a04e9-1cae-4c52-b6c2-31e3ad4432e7 tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments/c867f218-68b6-44eb-bf84-2d3e1644eeb2" status: 400 len: 107 microversion: 2.1 time: 0.391649 Nov 14 02:08:11 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 55/160] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 14 02:08:11 2023] PUT /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments/c867f218-68b6-44eb-bf84-2d3e1644eeb2 => generated 107 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:11 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'services' on Instance uuid fd62b270-19d7-45e5-bd66-a94c384050bd {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments/c867f218-68b6-44eb-bf84-2d3e1644eeb2" status: 202 len: 0 microversion: 2.1 time: 0.305005 Nov 14 02:08:12 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 54/161] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:08:11 2023] DELETE /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments/c867f218-68b6-44eb-bf84-2d3e1644eeb2 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a90067ba-6822-4997-848a-23cbd1036d86 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062825 Nov 14 02:08:12 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:08:12 2023] GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.027460 Nov 14 02:08:12 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 53/163] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Nov 14 02:08:09 2023] POST /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-interface => generated 283 bytes in 3029 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71282f04-b577-4513-8383-3f7510c0c6f1", "tag": "volume-tag"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-cad5880f-ea44-4d20-8d1b-b936858ddeae tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.417565 Nov 14 02:08:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 56/164] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:08:11 2023] GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-interface => generated 283 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.339150 Nov 14 02:08:12 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 56/165] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 14 02:08:12 2023] POST /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:08:12 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "07b9ece5-ed71-42e9-ae00-72829af206e8"}, {"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "07b9ece5-ed71-42e9-ae00-72829af206e8"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Creating event network-vif-plugged:07b9ece5-ed71-42e9-ae00-72829af206e8 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:08:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Creating event network-vif-plugged:07b9ece5-ed71-42e9-ae00-72829af206e8 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:08:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035636 Nov 14 02:08:12 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 54/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:13 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-48a18751-156a-40eb-b610-c1f119dd870c tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054433 Nov 14 02:08:13 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:08:12 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c24d19d-34aa-4f62-886b-3b261a4af901"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:13 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lazy-loading 'services' on Instance uuid 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments/3bf11fc4-8a29-4374-b194-5c840e14fd7b" status: 202 len: 0 microversion: 2.1 time: 0.164257 Nov 14 02:08:13 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 57/168] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:08:13 2023] DELETE /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments/3bf11fc4-8a29-4374-b194-5c840e14fd7b => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:08:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] 10.0.0.210 "POST /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366587 Nov 14 02:08:13 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 55/169] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:08:13 2023] POST /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:14 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1326183-c4cb-40fa-a352-470e2c69cb05", "tag": "fb5f3206-b474-4ff1-b22a-ec6169264796"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Creating event network-changed:fb5f3206-b474-4ff1-b22a-ec6169264796 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 on user Nov 14 02:08:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028774 Nov 14 02:08:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9b9bd15a-a94f-4d05-a60c-1d563b018c8f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879/os-interface" status: 200 len: 295 microversion: 2.93 time: 0.161646 Nov 14 02:08:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 58/171] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:08:17 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879/os-interface => generated 295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Creating event network-changed:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:08:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029101 Nov 14 02:08:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 59/172] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:18 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b2b6c174-655d-4572-8410-fb5b592b17b1 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 200 len: 1719 microversion: 2.93 time: 0.223438 Nov 14 02:08:18 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 56/173] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:08:18 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 1719 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsV293TestJSON-server-1126017660", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting quotas for project 91262b32dbc949beb98767d004ff9a73. Resources: dict_keys(['metadata_items']) {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting quotas for user 67156afa3d24427e90e99f944362ecfe and project 91262b32dbc949beb98767d004ff9a73. Resources: dict_keys(['metadata_items']) {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:19 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "POST /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879/action" status: 202 len: 2043 microversion: 2.93 time: 0.660963 Nov 14 02:08:19 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 59/174] 10.0.0.210 () {66 vars in 1397 bytes} [Tue Nov 14 02:08:19 2023] POST /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879/action => generated 2043 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 14 02:08:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-90ecf597-f77c-44e0-a31c-7e1bfc6ab2a4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-90ecf597-f77c-44e0-a31c-7e1bfc6ab2a4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 423 microversion: 2.93 time: 0.014728 Nov 14 02:08:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 60/175] 10.0.0.210 () {64 vars in 1249 bytes} [Tue Nov 14 02:08:19 2023] GET /compute/v2.1/flavors/1 => generated 423 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f65fd41d-0105-4c38-80a4-3c4bdd0c9902 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 200 len: 1866 microversion: 2.93 time: 0.208083 Nov 14 02:08:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 57/176] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:08:19 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 1866 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 14 02:08:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-unplugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}, {"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-plugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Creating event network-vif-unplugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:08:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Creating event network-vif-plugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:08:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032620 Nov 14 02:08:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 60/177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:23 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'services' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:08:23 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-volume_attachments/71282f04-b577-4513-8383-3f7510c0c6f1" status: 202 len: 0 microversion: 2.49 time: 0.238522 Nov 14 02:08:23 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 61/178] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 14 02:08:23 2023] DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-volume_attachments/71282f04-b577-4513-8383-3f7510c0c6f1 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "9c24d19d-34aa-4f62-886b-3b261a4af901", "create_info": {"snapshot_id": "aaa0ffd9-a527-4c1f-8eeb-b22d4acec444", "type": "qcow2", "new_file": "new_file"}}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff922a0f-fbdc-4dd7-ba91-19419fe3fa47(cell1) {{(pid=64866) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] 10.0.0.210 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.194889 Nov 14 02:08:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 58/179] 10.0.0.210 () {64 vars in 1287 bytes} [Tue Nov 14 02:08:25 2023] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff922a0f-fbdc-4dd7-ba91-19419fe3fa47(cell1) {{(pid=64867) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] 10.0.0.210 "DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%229c24d19d-34aa-4f62-886b-3b261a4af901%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.071480 Nov 14 02:08:25 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 61/180] 10.0.0.210 () {62 vars in 1442 bytes} [Tue Nov 14 02:08:25 2023] DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%229c24d19d-34aa-4f62-886b-3b261a4af901%22%7D => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lazy-loading 'services' on Instance uuid a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:08:25 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] 10.0.0.210 "DELETE /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments/9c24d19d-34aa-4f62-886b-3b261a4af901" status: 202 len: 0 microversion: 2.1 time: 0.221939 Nov 14 02:08:25 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 62/181] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:08:25 2023] DELETE /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments/9c24d19d-34aa-4f62-886b-3b261a4af901 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-eb779850-20d8-4656-adde-749f678ca023 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Nov 14 02:08:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 59/182] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:08:25 2023] GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "volume-reimaged", "server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "tag": "63a8b1e6-4579-48f6-8a4c-b75386826ce7"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Creating event volume-reimaged:63a8b1e6-4579-48f6-8a4c-b75386826ce7 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:08:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.93 time: 0.084614 Nov 14 02:08:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 62/183] 10.0.0.210 () {70 vars in 1437 bytes} [Tue Nov 14 02:08:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b3adeb0d-5099-4005-a8c0-5a16cfdde5ac tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046561 Nov 14 02:08:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 63/184] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:08:35 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-db835f20-a989-4993-b9da-a32cfb6f863b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046018 Nov 14 02:08:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 60/185] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:08:35 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:36 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:08:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1" status: 204 len: 0 microversion: 2.1 time: 0.203000 Nov 14 02:08:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:08:35 2023] DELETE /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd75fc-a135-4bc6-8853-e28dfc6219c1", "name": "network-vif-unplugged", "status": "completed", "tag": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:36 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6812b41d5b0f4a35b22dec35cd0d44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fe8be09f614bfcb6ea1bfc3adef743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fa3eaf65-a0e3-485f-b6fe-064fd714d5eb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1" status: 200 len: 1670 microversion: 2.1 time: 0.284481 Nov 14 02:08:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 64/187] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:36 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1 => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Creating event network-vif-unplugged:e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 on user Nov 14 02:08:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034021 Nov 14 02:08:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 61/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:37 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ac54d8d3-8f8e-487d-ab46-29bbeb0c5bd4 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19" status: 200 len: 1492 microversion: 2.1 time: 0.230501 Nov 14 02:08:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 64/189] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:37 2023] GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19 => generated 1492 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd75fc-a135-4bc6-8853-e28dfc6219c1", "name": "network-vif-plugged", "status": "completed", "tag": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf"}, {"server_uuid": "0bbd75fc-a135-4bc6-8853-e28dfc6219c1", "name": "network-vif-deleted", "tag": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Creating event network-vif-plugged:e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 on user Nov 14 02:08:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Creating event network-vif-deleted:e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 on user Nov 14 02:08:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044110 Nov 14 02:08:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 65/190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ceb129b3-3ca6-4efc-a3d0-3b7d0a1057bc tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '.version_select at 0x7fc9eb4ca440>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:39 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ceb129b3-3ca6-4efc-a3d0-3b7d0a1057bc tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239" status: 200 len: 1724 microversion: 2.1 time: 0.053470 Nov 14 02:08:39 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 65/191] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 14 02:08:39 2023] GET /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239 => generated 1724 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7985ab55-11ee-4063-9f25-e2934df66cb8 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '.version_select at 0x7fc9eb5515a0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7985ab55-11ee-4063-9f25-e2934df66cb8 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239" status: 200 len: 1724 microversion: 2.1 time: 0.054386 Nov 14 02:08:39 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 66/192] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 14 02:08:39 2023] GET /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239 => generated 1724 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-13e1949d-df99-4d0b-a9b8-137d633db749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1659 microversion: 2.1 time: 0.248190 Nov 14 02:08:39 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 62/193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:39 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1659 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:40 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-abe4acd1-0040-4b04-a2d7-bdd7cac11d75 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 200 len: 1671 microversion: 2.1 time: 0.279107 Nov 14 02:08:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 66/194] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:39 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 1671 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:40 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1be773a5-c13d-46f2-bacd-a01c6c7acd29 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1659 microversion: 2.1 time: 0.200732 Nov 14 02:08:40 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 63/195] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:39 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1659 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:08:40 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c1fd3efa9a4997be00910265484154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b17ddccd4d7d82adbc420ad6adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1faefacf-9b29-451d-accc-22752efffdac tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb" status: 200 len: 1564 microversion: 2.1 time: 0.226711 Nov 14 02:08:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:39 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb => generated 1564 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-plugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Creating event network-vif-plugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:08:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032936 Nov 14 02:08:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-plugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Creating event network-vif-plugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:08:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034033 Nov 14 02:08:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 64/198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-interface/07b9ece5-ed71-42e9-ae00-72829af206e8" status: 202 len: 0 microversion: 2.49 time: 0.060408 Nov 14 02:08:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 68/199] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Nov 14 02:08:46 2023] DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-interface/07b9ece5-ed71-42e9-ae00-72829af206e8 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=103,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:46 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=146,nova_cell1:UPDATE=12,nova_cell1:INSERT=10,nova_cell1:DELETE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7250de90-9d61-48dc-bfd5-1a0e0392945f tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-instance-actions/req-4430cc49-cca2-479d-943f-f392d6f822c7" status: 200 len: 474 microversion: 2.49 time: 0.285025 Nov 14 02:08:46 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 68/200] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 14 02:08:46 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-instance-actions/req-4430cc49-cca2-479d-943f-f392d6f822c7 => generated 474 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:08:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-unplugged", "status": "completed", "tag": "07b9ece5-ed71-42e9-ae00-72829af206e8"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=53 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=130,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Creating event network-vif-unplugged:07b9ece5-ed71-42e9-ae00-72829af206e8 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:08:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048527 Nov 14 02:08:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 65/201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=130,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:08:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] HTTP exception thrown: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. Nov 14 02:08:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Returning 404 to user: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:08:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bf8dadbc-61e2-48a1-a1c2-64b815909e62 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" status: 404 len: 111 microversion: 2.1 time: 0.032395 Nov 14 02:08:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 69/202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:47 2023] GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] HTTP exception thrown: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. Nov 14 02:08:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Returning 404 to user: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:08:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-eb2a921e-cbe2-4ccc-bd12-17052b26c208 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028404 Nov 14 02:08:47 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 69/203] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:08:47 2023] GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:48 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:08:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-06265d9e-7045-4e0c-8c3b-147ed2055d5c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1685 microversion: 2.1 time: 0.226236 Nov 14 02:08:48 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 66/204] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:47 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1685 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:08:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "07b9ece5-ed71-42e9-ae00-72829af206e8"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:08:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Creating event network-vif-plugged:07b9ece5-ed71-42e9-ae00-72829af206e8 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:08:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029439 Nov 14 02:08:48 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:08:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] HTTP exception thrown: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. Nov 14 02:08:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Returning 404 to user: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:08:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2dc96462-c35e-4661-8e35-d1eabf5f414b tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" status: 404 len: 111 microversion: 2.1 time: 0.026079 Nov 14 02:08:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 70/206] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:08:49 2023] DELETE /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:08:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:08:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] HTTP exception thrown: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. Nov 14 02:08:50 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Returning 404 to user: Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:08:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-2d96f134-34d3-4636-8abd-cc47c0deeba5 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" status: 404 len: 111 microversion: 2.1 time: 0.027941 Nov 14 02:08:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 67/207] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:08:49 2023] GET /compute/v2.1/servers/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=14 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1011a62b-6528-4caa-a26e-ad2a9bbf4de5 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057213 Nov 14 02:09:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 71/208] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:09:02 2023] GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-467865777", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=5 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=11 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] validate_networks() for [('18e0a90a-04a6-4a06-b7d2-6cb6b68906b9', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting quotas for project 2b4120a890b64ac9abb385f0ba8d3447. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting quotas for user 9e4dbe6bba744f4cabba17fcbea21c64 and project 2b4120a890b64ac9abb385f0ba8d3447. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:09:02 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:09:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.623692 Nov 14 02:09:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 71/209] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:09:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:09:03 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1ebc7bd2-7414-4140-9e9b-8047f135296a tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:03 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1ebc7bd2-7414-4140-9e9b-8047f135296a tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:03 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=5 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:03 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=9 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:03 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-1ebc7bd2-7414-4140-9e9b-8047f135296a tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1ebc7bd2-7414-4140-9e9b-8047f135296a tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe" status: 200 len: 1209 microversion: 2.1 time: 0.073828 Nov 14 02:09:03 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 68/210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:02 2023] GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe => generated 1209 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:05 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907693ff-78a5-4fd7-8f75-c70f6186cbbe", "tag": "cf51ac46-0972-4e4e-9fea-bc81307c13f9"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:05 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Creating event network-changed:cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe on user Nov 14 02:09:05 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041096 Nov 14 02:09:05 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 72/211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907693ff-78a5-4fd7-8f75-c70f6186cbbe", "name": "network-vif-plugged", "status": "completed", "tag": "cf51ac46-0972-4e4e-9fea-bc81307c13f9"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Creating event network-vif-plugged:cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe on user Nov 14 02:09:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031869 Nov 14 02:09:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-deleted", "tag": "07b9ece5-ed71-42e9-ae00-72829af206e8"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Creating event network-vif-deleted:07b9ece5-ed71-42e9-ae00-72829af206e8 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Nov 14 02:09:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 69/213] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907693ff-78a5-4fd7-8f75-c70f6186cbbe", "name": "network-vif-plugged", "status": "completed", "tag": "cf51ac46-0972-4e4e-9fea-bc81307c13f9"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Creating event network-vif-plugged:cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe on user Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034777 Nov 14 02:09:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 73/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:10 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7432d012-99b6-49e0-9a1b-58c97079aafb tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 200 len: 1857 microversion: 2.93 time: 0.270474 Nov 14 02:09:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 73/215] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:09:10 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 1857 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:09:14 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:14 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-51526c9a-7772-4b3f-bca5-bda16fa62bef tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb54beb0>, body: {"keypair": {"name": "tempest-keypair-1397456095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:14 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-51526c9a-7772-4b3f-bca5-bda16fa62bef tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting quotas for project a8e8769c7e544a05a5a9ac80bda1639b. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:09:14 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-51526c9a-7772-4b3f-bca5-bda16fa62bef tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting quotas for user afc679b09a1643b2963e33a2c5059cd8 and project a8e8769c7e544a05a5a9ac80bda1639b. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:09:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-51526c9a-7772-4b3f-bca5-bda16fa62bef tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.046165 Nov 14 02:09:14 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 70/216] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 14 02:09:14 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:09:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1564274647", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78"}, {"port": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "tag": "port-1"}, {"port": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "tag": "port-2"}, {"uuid": "164a6a04-0f10-46ef-9619-d131b1fcf204", "tag": "net-1"}, {"uuid": "164a6a04-0f10-46ef-9619-d131b1fcf204"}, {"uuid": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "80a21b79-bdd1-4efb-b413-c3e783a6770f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1832189712"}], "key_name": "tempest-keypair-1397456095", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:15 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] validate_networks() for [('2e1fdf2a-bf16-456d-ab5a-3d43518b2c78', None, None, None, None, None), (None, None, '90c018ce-1c12-4cb8-9d98-070fd8a1810a', None, None, None), (None, None, '4a898ff3-bac1-49d0-8d99-f3fc06539056', None, None, None), ('164a6a04-0f10-46ef-9619-d131b1fcf204', None, None, None, None, None), ('164a6a04-0f10-46ef-9619-d131b1fcf204', None, None, None, None, None), ('a956ca95-3ed3-4b19-ae00-dd5ab51f84ab', '10.2.2.100', None, None, None, None), ('a956ca95-3ed3-4b19-ae00-dd5ab51f84ab', '10.2.2.200', None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:16 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a638d366-b32a-4c60-88b7-495c790ab111 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079464 Nov 14 02:09:16 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 74/217] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:09:15 2023] GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting quotas for project a8e8769c7e544a05a5a9ac80bda1639b. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting quotas for user afc679b09a1643b2963e33a2c5059cd8 and project a8e8769c7e544a05a5a9ac80bda1639b. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:09:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80a21b79-bdd1-4efb-b413-c3e783a6770f',volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:09:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.149648 Nov 14 02:09:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 74/218] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 14 02:09:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:09:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-eaf96127-d07a-4611-9fe1-561d390b0133 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:17 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-eaf96127-d07a-4611-9fe1-561d390b0133 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:17 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-eaf96127-d07a-4611-9fe1-561d390b0133 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:17 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-eaf96127-d07a-4611-9fe1-561d390b0133 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:17 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-eaf96127-d07a-4611-9fe1-561d390b0133 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-eaf96127-d07a-4611-9fe1-561d390b0133 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 200 len: 1278 microversion: 2.42 time: 0.064209 Nov 14 02:09:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 71/219] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:09:17 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 1278 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:18 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:09:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05" status: 204 len: 0 microversion: 2.1 time: 0.127995 Nov 14 02:09:18 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 75/220] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:09:18 2023] DELETE /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1326183-c4cb-40fa-a352-470e2c69cb05", "name": "network-vif-unplugged", "status": "completed", "tag": "fb5f3206-b474-4ff1-b22a-ec6169264796"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:18 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Creating event network-vif-unplugged:fb5f3206-b474-4ff1-b22a-ec6169264796 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 on user Nov 14 02:09:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035629 Nov 14 02:09:18 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 72/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:18 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a4a3f1b20246e3b1e50bbd76a498fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da668843b57c40ee9f230c5912bb2709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3d957734-6f74-4d77-82bb-11864d6f3987 tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05" status: 200 len: 1675 microversion: 2.1 time: 0.400449 Nov 14 02:09:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:18 2023] GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05 => generated 1675 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1326183-c4cb-40fa-a352-470e2c69cb05", "name": "network-vif-plugged", "status": "completed", "tag": "fb5f3206-b474-4ff1-b22a-ec6169264796"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Creating event network-vif-plugged:fb5f3206-b474-4ff1-b22a-ec6169264796 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 on user Nov 14 02:09:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049557 Nov 14 02:09:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 76/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:21 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-aa1aa920-d419-4df7-99d9-584d06cfdc0d req-5e8c2fee-410d-4c65-8c89-3f88fc6772d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1326183-c4cb-40fa-a352-470e2c69cb05", "name": "network-vif-deleted", "tag": "fb5f3206-b474-4ff1-b22a-ec6169264796"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-aa1aa920-d419-4df7-99d9-584d06cfdc0d req-5e8c2fee-410d-4c65-8c89-3f88fc6772d8 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-aa1aa920-d419-4df7-99d9-584d06cfdc0d req-5e8c2fee-410d-4c65-8c89-3f88fc6772d8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-aa1aa920-d419-4df7-99d9-584d06cfdc0d req-5e8c2fee-410d-4c65-8c89-3f88fc6772d8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:21 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-aa1aa920-d419-4df7-99d9-584d06cfdc0d req-5e8c2fee-410d-4c65-8c89-3f88fc6772d8 service nova] Creating event network-vif-deleted:fb5f3206-b474-4ff1-b22a-ec6169264796 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 on user Nov 14 02:09:21 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-aa1aa920-d419-4df7-99d9-584d06cfdc0d req-5e8c2fee-410d-4c65-8c89-3f88fc6772d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042971 Nov 14 02:09:21 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 73/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:24 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "dee8e8d1-721c-4209-8bd4-b0c873f68c66"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Creating event network-changed:dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031748 Nov 14 02:09:24 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 76/225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] HTTP exception thrown: Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 could not be found. Nov 14 02:09:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Returning 404 to user: Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:09:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-41016f85-6dc7-4640-ba16-b022e1bbf031 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1" status: 404 len: 111 microversion: 2.1 time: 0.026275 Nov 14 02:09:26 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:26 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:09:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a8257cf4-9e25-4eba-8ac3-c09517ebe02f tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '.version_select at 0x7fc9eb480e50>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "90c018ce-1c12-4cb8-9d98-070fd8a1810a"}, {"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "4a898ff3-bac1-49d0-8d99-f3fc06539056"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a8257cf4-9e25-4eba-8ac3-c09517ebe02f tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154414656" status: 202 len: 0 microversion: 2.1 time: 0.023355 Nov 14 02:09:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 74/227] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:09:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154414656 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:09:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Creating event network-changed:90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Creating event network-changed:4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032618 Nov 14 02:09:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 77/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:26 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e"}, {"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1"}, {"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "135ef6eb-a5e3-4537-b64f-404b6bca66f5"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Creating event network-changed:bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Creating event network-changed:02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Creating event network-changed:135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.034510 Nov 14 02:09:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 78/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:28 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] HTTP exception thrown: Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 could not be found. Nov 14 02:09:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Returning 404 to user: Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:09:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-25e83174-8093-4114-8e4d-6e86f046a7ab tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1" status: 404 len: 111 microversion: 2.1 time: 0.030126 Nov 14 02:09:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 75/230] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:09:29 2023] DELETE /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] HTTP exception thrown: Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 could not be found. Nov 14 02:09:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Returning 404 to user: Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:09:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-6016450f-f393-41f0-9fbc-981a7a6ba4a3 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1" status: 404 len: 111 microversion: 2.1 time: 0.031326 Nov 14 02:09:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:29 2023] GET /compute/v2.1/servers/0bbd75fc-a135-4bc6-8853-e28dfc6219c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:09:30 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "8a2fed29-201a-4e15-a780-532c03191f10"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Creating event network-changed:8a2fed29-201a-4e15-a780-532c03191f10 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034059 Nov 14 02:09:30 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-83a1d395-47cf-423e-a3e7-78e87152ef00 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-instance-actions/req-4430cc49-cca2-479d-943f-f392d6f822c7" status: 200 len: 503 microversion: 2.49 time: 0.094445 Nov 14 02:09:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 76/233] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 14 02:09:36 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-instance-actions/req-4430cc49-cca2-479d-943f-f392d6f822c7 => generated 503 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1ab7d988-da09-49f1-b87c-7b261539db06 tempest-TaggedAttachmentsTest-215495300 tempest-TaggedAttachmentsTest-215495300-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-instance-actions/req-4430cc49-cca2-479d-943f-f392d6f822c7" status: 200 len: 503 microversion: 2.49 time: 0.081117 Nov 14 02:09:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 79/234] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 14 02:09:36 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-instance-actions/req-4430cc49-cca2-479d-943f-f392d6f822c7 => generated 503 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-0dd52661-a99b-485e-9c35-c506a46f3fc7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.048207 Nov 14 02:09:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 80/235] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 14 02:09:36 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:09:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 204 len: 0 microversion: 2.49 time: 0.117759 Nov 14 02:09:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 77/236] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:09:37 2023] DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-unplugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-4d03fa2b-afb3-4a00-afb3-7651960d69bd tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 200 len: 1753 microversion: 2.49 time: 0.266289 Nov 14 02:09:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 80/237] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:09:37 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 1753 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 14 02:09:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Creating event network-vif-unplugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030125 Nov 14 02:09:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 78/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:09:37 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:09:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19" status: 204 len: 0 microversion: 2.1 time: 0.288297 Nov 14 02:09:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:09:37 2023] DELETE /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:37 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b367862a-a7ed-411f-821c-fafe15133aca tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19" status: 200 len: 1498 microversion: 2.1 time: 0.233327 Nov 14 02:09:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 81/240] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:37 2023] GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19 => generated 1498 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:39 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}, {"server_uuid": "b950c25e-2910-4de3-a9fc-30e4091dfe19", "name": "network-vif-unplugged", "status": "completed", "tag": "3ec017bb-c846-419e-a33f-860b071d3b18"}, {"server_uuid": "b950c25e-2910-4de3-a9fc-30e4091dfe19", "name": "network-vif-plugged", "status": "completed", "tag": "3ec017bb-c846-419e-a33f-860b071d3b18"}, {"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}, {"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}, {"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-unplugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Creating event network-vif-plugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Creating event network-vif-unplugged:3ec017bb-c846-419e-a33f-860b071d3b18 for instance b950c25e-2910-4de3-a9fc-30e4091dfe19 on user Nov 14 02:09:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Creating event network-vif-plugged:3ec017bb-c846-419e-a33f-860b071d3b18 for instance b950c25e-2910-4de3-a9fc-30e4091dfe19 on user Nov 14 02:09:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Creating event network-vif-plugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Creating event network-vif-plugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Creating event network-vif-unplugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.042319 Nov 14 02:09:39 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 79/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9248f1fb-4989-414c-be7b-321de6fcbf56 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.474454 Nov 14 02:09:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 82/242] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:09:40 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-interface => generated 283 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-38d759c4-4fbe-4906-aeb0-7cf2437ab626 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb482b00>, body: {"keypair": {"name": "tempest-keypair-808543668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvMChb+aecwn40wfnvjF+Z4X1IXJnC2lqu7jzDw+N4Tyc9AiF8NWxVLA5y/hDnNYJ0o67tDS/YoN1aso6ftvlo/jonqLcgPcHXmzabpe0UOICeVkW5vaXUUBYQhWe3WJQ=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:40 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-38d759c4-4fbe-4906-aeb0-7cf2437ab626 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for project a1ba9547629f4ea1b40424e277e17d25. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:09:40 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-38d759c4-4fbe-4906-aeb0-7cf2437ab626 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for user 7ffa5574e531479993ef301510f1d9e3 and project a1ba9547629f4ea1b40424e277e17d25. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:09:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-38d759c4-4fbe-4906-aeb0-7cf2437ab626 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096562 Nov 14 02:09:40 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 80/243] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:09:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:40 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d9353039-c306-488e-9bcd-dd0b55b6e0e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 200 len: 1671 microversion: 2.1 time: 0.346171 Nov 14 02:09:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:40 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 1671 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a26d0df-3e86-4e5e-bd0d-5deae5534d5a"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394745 Nov 14 02:09:41 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 83/245] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:09:40 2023] POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}, {"server_uuid": "b950c25e-2910-4de3-a9fc-30e4091dfe19", "name": "network-vif-deleted", "tag": "3ec017bb-c846-419e-a33f-860b071d3b18"}, {"server_uuid": "8de0ee5b-852a-4146-ba87-378181e1cfc4", "name": "network-vif-deleted", "tag": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Creating event network-vif-plugged:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Creating event network-vif-deleted:3ec017bb-c846-419e-a33f-860b071d3b18 for instance b950c25e-2910-4de3-a9fc-30e4091dfe19 on user Nov 14 02:09:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Creating event network-vif-deleted:f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 on user Nov 14 02:09:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041475 Nov 14 02:09:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 81/246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:41 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "dee8e8d1-721c-4209-8bd4-b0c873f68c66"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Creating event network-vif-plugged:dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067428 Nov 14 02:09:41 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 84/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c1fd3efa9a4997be00910265484154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b17ddccd4d7d82adbc420ad6adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9d955f4c-f366-4044-a164-a26dda086ff6 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb" status: 200 len: 1564 microversion: 2.1 time: 0.335385 Nov 14 02:09:42 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 83/248] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:41 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb => generated 1564 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83c1fd3efa9a4997be00910265484154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b17ddccd4d7d82adbc420ad6adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Searching by: {'deleted': False, 'project_id': '5778b17ddccd4d7d82adbc420ad6adc0'} {{(pid=64866) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "90c018ce-1c12-4cb8-9d98-070fd8a1810a"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:42 user devstack@n-api.service[64866]: DEBUG nova.compute.multi_cell_list [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64866) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 14 02:09:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Creating event network-vif-plugged:90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036734 Nov 14 02:09:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 85/249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:42 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-02634f33-3957-4fa3-905f-207f043b40ed tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 351 microversion: 2.1 time: 0.211080 Nov 14 02:09:42 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 82/250] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 14 02:09:42 2023] GET /compute/v2.1/servers => generated 351 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f01f386a-4a49-4a3f-932c-f3bdd88a29a4"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1741521006", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "dc8c6c51-2843-43f4-95cf-8e873f067676"}], "security_groups": [{"name": "tempest-securitygroup--2077302367"}], "key_name": "tempest-keypair-808543668", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479760 Nov 14 02:09:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 84/251] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:09:42 2023] POST /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:43 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] validate_networks() for [('dc8c6c51-2843-43f4-95cf-8e873f067676', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:09:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6df88a-5599-4b10-917c-c3c0b009c3cb", "tag": "7946fb64-2722-4b7d-a7bc-5223ad6536e5"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Creating event network-changed:7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb on user Nov 14 02:09:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043462 Nov 14 02:09:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 83/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:09:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "dee8e8d1-721c-4209-8bd4-b0c873f68c66"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "4a898ff3-bac1-49d0-8d99-f3fc06539056"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "4a898ff3-bac1-49d0-8d99-f3fc06539056"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "135ef6eb-a5e3-4537-b64f-404b6bca66f5"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "135ef6eb-a5e3-4537-b64f-404b6bca66f5"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Creating event network-vif-plugged:dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Creating event network-vif-plugged:4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Creating event network-vif-plugged:4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Creating event network-vif-plugged:bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Creating event network-vif-plugged:bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Creating event network-vif-plugged:135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Creating event network-vif-plugged:135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.058764 Nov 14 02:09:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 14 02:09:43 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for user 7ffa5574e531479993ef301510f1d9e3 and project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:09:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:09:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.395380 Nov 14 02:09:44 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 86/254] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:09:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:09:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-41c6b4c4-4576-44d3-ab6f-103083505a48 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:44 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-41c6b4c4-4576-44d3-ab6f-103083505a48 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:44 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "90c018ce-1c12-4cb8-9d98-070fd8a1810a"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Creating event network-vif-plugged:90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033328 Nov 14 02:09:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:44 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-41c6b4c4-4576-44d3-ab6f-103083505a48 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-41c6b4c4-4576-44d3-ab6f-103083505a48 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1233 microversion: 2.1 time: 0.130941 Nov 14 02:09:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 84/256] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:44 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1233 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Creating event network-vif-plugged:02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Creating event network-vif-plugged:02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036131 Nov 14 02:09:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 87/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "8a2fed29-201a-4e15-a780-532c03191f10"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "8a2fed29-201a-4e15-a780-532c03191f10"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Creating event network-vif-plugged:8a2fed29-201a-4e15-a780-532c03191f10 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Creating event network-vif-plugged:8a2fed29-201a-4e15-a780-532c03191f10 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:09:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045063 Nov 14 02:09:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 87/258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Creating event network-changed:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:09:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045582 Nov 14 02:09:47 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 85/259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:48 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:48 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Going to try to start instance {{(pid=64867) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 14 02:09:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action" status: 202 len: 0 microversion: 2.1 time: 0.105515 Nov 14 02:09:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 88/260] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:09:48 2023] POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:48 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fe502256-4131-4125-bff4-5193c820d6d7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1694 microversion: 2.1 time: 0.318566 Nov 14 02:09:48 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:48 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1694 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "b509ff61-3da4-44ab-b845-45e446a66239"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:49 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'flavor' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:09:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/action" status: 200 len: 29 microversion: 2.1 time: 0.251107 Nov 14 02:09:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 86/262] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:09:49 2023] POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/action => generated 29 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:49 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e2f937e7-6100-4140-b45e-91711b40320d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 200 len: 1723 microversion: 2.1 time: 0.396955 Nov 14 02:09:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 89/263] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:49 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-unplugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Creating event network-vif-unplugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:09:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056211 Nov 14 02:09:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 89/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:50 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-plugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Creating event network-vif-plugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:09:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052217 Nov 14 02:09:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 87/265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG nova.compute.api [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-034241d6-fc5c-42b5-bfa4-77652543bf60 req-3c189ee9-5023-4298-b8f0-e5f4fd5e2f54 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 200 len: 302 microversion: 2.89 time: 0.180665 Nov 14 02:09:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 90/266] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:09:51 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG nova.compute.api [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d98aa900-ddb4-437b-8196-8eff782bcb66 req-922edfad-6852-4114-ab77-da64bb4b803d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 200 len: 302 microversion: 2.89 time: 0.109166 Nov 14 02:09:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 90/267] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:09:52 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 302 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG nova.compute.api [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-73b478d1-ce22-4537-8c38-16d424cc2739 req-360a2c17-fca5-4bef-a803-5e4a5887487e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 200 len: 302 microversion: 2.89 time: 0.106838 Nov 14 02:09:52 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 88/268] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:09:52 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:09:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058731 Nov 14 02:09:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 91/269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-plugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Creating event network-vif-plugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:09:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035364 Nov 14 02:09:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 91/270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG nova.compute.api [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-8b537cc0-c1bf-48ea-b1e1-c0c1423c1a5b req-9ea9a5f5-8e38-4479-afcd-9612642fa354 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 200 len: 302 microversion: 2.89 time: 0.288925 Nov 14 02:09:53 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 89/271] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:09:53 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:53 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:09:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ab2b1368-cc0d-48aa-ba40-e8ad9b521e8c tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe" status: 200 len: 1492 microversion: 2.1 time: 0.534500 Nov 14 02:09:53 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 92/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:09:53 2023] GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe => generated 1492 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG nova.compute.api [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-8063b148-f996-46bc-a2ad-683aa6366bef req-7f1772b3-2173-4b1a-a73e-ba69807b8fa0 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 200 len: 302 microversion: 2.89 time: 0.135349 Nov 14 02:09:54 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 92/273] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:09:53 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-150e177b-142f-4050-b017-46b123d75acf req-82a42718-37a9-4531-833e-5282ddacd4e1 tempest-TestServerVolumeAttachmentScenario-1491713603 tempest-TestServerVolumeAttachmentScenario-1491713603-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 200 len: 302 microversion: 2.89 time: 0.151510 Nov 14 02:09:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 90/274] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:09:54 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27360132-699a-4854-96d9-cb7a7936f337"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321882 Nov 14 02:09:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 93/275] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:09:54 2023] POST /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:09:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051988 Nov 14 02:09:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 93/276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}, {"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}, {"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:09:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:09:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:09:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:09:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:09:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:09:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.080001 Nov 14 02:09:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 91/277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:09:58 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:09:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e62e034e-aff5-43fc-8b63-b61b656fa3c9 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb2297e0>, body: {"keypair": {"name": "tempest-keypair-343931820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7RzV/4Ypkr9Ux4gBjv/6XnOLctGJvPbC68tHH5zEAYEzzHjvU9DI9lPLMmf+YRNz+/cZcpYDl9EEuPGW0KMFdut0kCse1RyMksPvsUw7Fgv3s1R4iIdE2/n+CMGHHu3g=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:09:59 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-e62e034e-aff5-43fc-8b63-b61b656fa3c9 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Getting quotas for project 94ac0058ef794b9b860bf77eec4e6ac0. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:09:59 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-e62e034e-aff5-43fc-8b63-b61b656fa3c9 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Getting quotas for user 817e73cf3aab4227baee2a818261aa41 and project 94ac0058ef794b9b860bf77eec4e6ac0. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:09:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e62e034e-aff5-43fc-8b63-b61b656fa3c9 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052550 Nov 14 02:09:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 94/278] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:09:59 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-405678036", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "a1a582cc-802d-4caa-b01e-3ee12453e79a"}], "security_groups": [{"name": "tempest-securitygroup--1376059486"}], "key_name": "tempest-keypair-343931820", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:01 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] validate_networks() for [('a1a582cc-802d-4caa-b01e-3ee12453e79a', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Getting quotas for project 94ac0058ef794b9b860bf77eec4e6ac0. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Getting quotas for user 817e73cf3aab4227baee2a818261aa41 and project 94ac0058ef794b9b860bf77eec4e6ac0. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:10:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:10:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.571063 Nov 14 02:10:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 94/279] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:10:01 2023] POST /compute/v2.1/servers => generated 404 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:10:02 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e59d6ebf-e9e4-444d-a6b0-3741f1670f18 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:02 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e59d6ebf-e9e4-444d-a6b0-3741f1670f18 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:02 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-e59d6ebf-e9e4-444d-a6b0-3741f1670f18 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817e73cf3aab4227baee2a818261aa41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ac0058ef794b9b860bf77eec4e6ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e59d6ebf-e9e4-444d-a6b0-3741f1670f18 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692" status: 200 len: 1222 microversion: 2.1 time: 0.071630 Nov 14 02:10:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 92/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:02 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692 => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=125,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:04 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'services' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:10:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/27360132-699a-4854-96d9-cb7a7936f337" status: 202 len: 0 microversion: 2.1 time: 0.299999 Nov 14 02:10:04 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:10:04 2023] DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/27360132-699a-4854-96d9-cb7a7936f337 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-011f0f77-0a30-4878-917a-696ac91bc05d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.083830 Nov 14 02:10:04 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:10:04 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89aad70-7a33-4519-8308-f9ed98031692", "tag": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:05 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Creating event network-changed:4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance d89aad70-7a33-4519-8308-f9ed98031692 on user Nov 14 02:10:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058131 Nov 14 02:10:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 93/283] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:08 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89aad70-7a33-4519-8308-f9ed98031692", "name": "network-vif-plugged", "status": "completed", "tag": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Creating event network-vif-plugged:4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance d89aad70-7a33-4519-8308-f9ed98031692 on user Nov 14 02:10:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092216 Nov 14 02:10:08 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 96/284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:08 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ad11c651-e677-467b-a8d5-5322db61e258 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 200 len: 2827 microversion: 2.42 time: 0.636711 Nov 14 02:10:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 96/285] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:10:08 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 2827 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] HTTP exception thrown: Instance a1326183-c4cb-40fa-a352-470e2c69cb05 could not be found. Nov 14 02:10:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Returning 404 to user: Instance a1326183-c4cb-40fa-a352-470e2c69cb05 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:10:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-53b5b130-2cf0-4a54-b304-b65b6fa2e1bb tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05" status: 404 len: 111 microversion: 2.1 time: 0.026637 Nov 14 02:10:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 94/286] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:08 2023] GET /compute/v2.1/servers/a1326183-c4cb-40fa-a352-470e2c69cb05 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:10:08 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a855df37-000b-4cdc-a797-6a9f80ecfe3d tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Calling method '.version_select at 0x7fc9eb4a3f40>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a855df37-000b-4cdc-a797-6a9f80ecfe3d tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172015827" status: 202 len: 0 microversion: 2.1 time: 0.023067 Nov 14 02:10:08 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:10:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172015827 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:10:10 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89aad70-7a33-4519-8308-f9ed98031692", "name": "network-vif-plugged", "status": "completed", "tag": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Creating event network-vif-plugged:4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance d89aad70-7a33-4519-8308-f9ed98031692 on user Nov 14 02:10:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046772 Nov 14 02:10:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:10 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b6ad3336-7cdb-4909-97f8-85e48418f514 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 200 len: 1857 microversion: 2.93 time: 0.253000 Nov 14 02:10:10 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 95/289] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:10:10 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 1857 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:11 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:10:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 204 len: 0 microversion: 2.93 time: 0.115704 Nov 14 02:10:11 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 98/290] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:10:11 2023] DELETE /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:11 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-24b4b24b-27aa-42c4-85a1-e902919ea3d9 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 200 len: 1863 microversion: 2.93 time: 0.491926 Nov 14 02:10:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 98/291] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:10:11 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 1863 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:10:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-unplugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Creating event network-vif-unplugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:10:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032752 Nov 14 02:10:11 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 96/292] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:13 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-plugged", "status": "completed", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}, {"server_uuid": "42d01836-ef5a-4dba-ab6a-49bfe7976879", "name": "network-vif-deleted", "tag": "7c8790c5-8202-4e02-94e3-3581d766cc78"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:13 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:13 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:13 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Creating event network-vif-plugged:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:10:13 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Creating event network-vif-deleted:7c8790c5-8202-4e02-94e3-3581d766cc78 for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 on user Nov 14 02:10:13 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035102 Nov 14 02:10:13 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 99/293] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=9 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] HTTP exception thrown: Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 could not be found. Nov 14 02:10:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Returning 404 to user: Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:10:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-fef7106f-425d-4abb-b1c3-c64eab790f4e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 404 len: 111 microversion: 2.49 time: 0.045028 Nov 14 02:10:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 99/294] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:10:27 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:10:27 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:27 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=9 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:27 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5daa1928-dea5-4988-9fcd-8540f8c45c6e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '.version_select at 0x7fc9eb4f9f30>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5daa1928-dea5-4988-9fcd-8540f8c45c6e tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715447766" status: 204 len: 0 microversion: 2.49 time: 0.030653 Nov 14 02:10:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 97/295] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 14 02:10:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715447766 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] HTTP exception thrown: Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 could not be found. Nov 14 02:10:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Returning 404 to user: Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:10:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bb88ac59-6e29-46ab-946f-21336ddb4410 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19" status: 404 len: 111 microversion: 2.1 time: 0.044414 Nov 14 02:10:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:28 2023] GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:28 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-509600be-a9a5-41ab-a94e-d0c6db47c30c tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 200 len: 1492 microversion: 2.1 time: 0.250947 Nov 14 02:10:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:28 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 1492 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] HTTP exception thrown: Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 could not be found. Nov 14 02:10:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Returning 404 to user: Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:10:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d071b9b1-98a2-45cf-8c3b-b167ff9859d4 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 404 len: 111 microversion: 2.49 time: 0.026903 Nov 14 02:10:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 98/298] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:10:28 2023] DELETE /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] HTTP exception thrown: Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 could not be found. Nov 14 02:10:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Returning 404 to user: Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:10:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-f2a07379-cf2c-4eca-9b07-37d18dc4f764 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4" status: 404 len: 111 microversion: 2.49 time: 0.040457 Nov 14 02:10:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 101/299] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:10:29 2023] GET /compute/v2.1/servers/8de0ee5b-852a-4146-ba87-378181e1cfc4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:34 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-65affaf2-f4fa-4434-8df0-af27d2100a20 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1542 microversion: 2.1 time: 0.342604 Nov 14 02:10:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:34 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1542 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:39 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-05b17946-f1c4-497e-8faa-6f77d79dc009 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1698 microversion: 2.1 time: 0.515209 Nov 14 02:10:39 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 99/301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:38 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1698 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:40 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-dbeb7ab9-c066-4bb0-910b-e8f1be926844 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 200 len: 1703 microversion: 2.1 time: 0.369660 Nov 14 02:10:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 102/302] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:39 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 1703 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=14 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:52 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817e73cf3aab4227baee2a818261aa41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ac0058ef794b9b860bf77eec4e6ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-64a36399-5834-4c0d-ac53-19a92031830c tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692" status: 200 len: 1521 microversion: 2.1 time: 0.311088 Nov 14 02:10:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:52 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7d7d2a4c-bf7c-4692-a904-6c1875005f70 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056503 Nov 14 02:10:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 100/304] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:10:54 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:54 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'services' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:10:55 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 202 len: 0 microversion: 2.1 time: 0.202413 Nov 14 02:10:55 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:10:54 2023] DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c6ef735e-50b8-450b-a370-9add7c31c163"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-89316478-4eb6-4ccb-b4ee-0adbc75eb28c tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048136 Nov 14 02:10:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 101/306] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:10:55 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] HTTP exception thrown: Volume 4234082d-cf5c-40e2-b344-68a8c6d8a76d could not be found. Nov 14 02:10:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] Returning 404 to user: Volume 4234082d-cf5c-40e2-b344-68a8c6d8a76d could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:10:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c29aa627-c3cb-4301-8bd3-3ba66185c53b tempest-VolumesAdminNegativeTest-37493482 tempest-VolumesAdminNegativeTest-37493482-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe/os-volume_attachments/4234082d-cf5c-40e2-b344-68a8c6d8a76d" status: 404 len: 109 microversion: 2.1 time: 0.077699 Nov 14 02:10:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 103/307] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 14 02:10:55 2023] PUT /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe/os-volume_attachments/4234082d-cf5c-40e2-b344-68a8c6d8a76d => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:10:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe" status: 204 len: 0 microversion: 2.1 time: 0.110477 Nov 14 02:10:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 104/308] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:10:57 2023] DELETE /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:57 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:10:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907693ff-78a5-4fd7-8f75-c70f6186cbbe", "name": "network-vif-unplugged", "status": "completed", "tag": "cf51ac46-0972-4e4e-9fea-bc81307c13f9"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b980d363-0b2f-40f6-b784-a4c274d3bdc8 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe" status: 200 len: 1498 microversion: 2.1 time: 0.239753 Nov 14 02:10:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 102/309] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:10:57 2023] GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:10:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Creating event network-vif-unplugged:cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe on user Nov 14 02:10:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035244 Nov 14 02:10:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907693ff-78a5-4fd7-8f75-c70f6186cbbe", "name": "network-vif-deleted", "tag": "cf51ac46-0972-4e4e-9fea-bc81307c13f9"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] Creating event network-vif-deleted:cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe on user Nov 14 02:10:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030374 Nov 14 02:10:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 105/311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:10:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907693ff-78a5-4fd7-8f75-c70f6186cbbe", "name": "network-vif-plugged", "status": "completed", "tag": "cf51ac46-0972-4e4e-9fea-bc81307c13f9"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:10:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:10:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:10:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:10:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Creating event network-vif-plugged:cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe on user Nov 14 02:10:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030531 Nov 14 02:10:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 103/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:10:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] HTTP exception thrown: Instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 could not be found. Nov 14 02:11:01 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Returning 404 to user: Instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:11:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5b0c3917-297c-4bf8-9675-41f056e7246d tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879" status: 404 len: 111 microversion: 2.93 time: 0.209991 Nov 14 02:11:01 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 105/313] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:11:01 2023] GET /compute/v2.1/servers/42d01836-ef5a-4dba-ab6a-49bfe7976879 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:11:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a12bf5e9-de72-45c1-b174-37db67fa6b73 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Calling method '.version_select at 0x7fc9eb3fb370>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a12bf5e9-de72-45c1-b174-37db67fa6b73 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586767792" status: 204 len: 0 microversion: 2.93 time: 0.023366 Nov 14 02:11:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 106/314] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 14 02:11:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586767792 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:09 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a17292a2-e000-4fad-bb59-5a4631d6a677 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.302243 Nov 14 02:11:09 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 104/315] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:11:08 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/os-interface => generated 1829 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:11:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "tag": "dee8e8d1-721c-4209-8bd4-b0c873f68c66"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Creating event network-changed:dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042947 Nov 14 02:11:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 106/316] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:10 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-106a7105-23b4-4d31-a66e-680bc55a6a87 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 200 len: 2827 microversion: 2.42 time: 0.440321 Nov 14 02:11:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 107/317] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:11:10 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 2827 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7479f1e6-89b5-4e92-aaa9-6818579d1344 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.175699 Nov 14 02:11:10 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 105/318] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:11:10 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/os-interface => generated 1829 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:12 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:11:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 204 len: 0 microversion: 2.42 time: 0.159590 Nov 14 02:11:12 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 107/319] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:11:12 2023] DELETE /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:12 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-42f624d4-0520-4188-b0c6-960780ad78b5 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 200 len: 2951 microversion: 2.42 time: 0.371581 Nov 14 02:11:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 108/320] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:11:12 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 2951 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:11:13 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-unplugged", "status": "completed", "tag": "dee8e8d1-721c-4209-8bd4-b0c873f68c66"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Creating event network-vif-unplugged:dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069095 Nov 14 02:11:13 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 106/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-unplugged", "status": "completed", "tag": "90c018ce-1c12-4cb8-9d98-070fd8a1810a"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Creating event network-vif-unplugged:90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.397035 Nov 14 02:11:13 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 108/322] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:13 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1676388090", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "02278215-38bd-499d-a1ab-1d2bb873b0ee"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:13 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] validate_networks() for [('02278215-38bd-499d-a1ab-1d2bb873b0ee', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for user addcfdac50de4b03bd3ad3142508edea and project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:11:14 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:11:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.138978 Nov 14 02:11:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 109/323] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:11:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:11:14 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-493e20fe-3de1-4a2a-ad94-afe42360d2ab tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:14 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-493e20fe-3de1-4a2a-ad94-afe42360d2ab tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:14 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-493e20fe-3de1-4a2a-ad94-afe42360d2ab tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:14 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-493e20fe-3de1-4a2a-ad94-afe42360d2ab tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:14 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-493e20fe-3de1-4a2a-ad94-afe42360d2ab tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-493e20fe-3de1-4a2a-ad94-afe42360d2ab tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a" status: 200 len: 1395 microversion: 2.87 time: 0.086239 Nov 14 02:11:14 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 107/324] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:11:14 2023] GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a => generated 1395 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:11:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "dee8e8d1-721c-4209-8bd4-b0c873f68c66"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-unplugged", "status": "completed", "tag": "4a898ff3-bac1-49d0-8d99-f3fc06539056"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "4a898ff3-bac1-49d0-8d99-f3fc06539056"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-unplugged", "status": "completed", "tag": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-unplugged", "status": "completed", "tag": "135ef6eb-a5e3-4537-b64f-404b6bca66f5"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "135ef6eb-a5e3-4537-b64f-404b6bca66f5"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-unplugged", "status": "completed", "tag": "8a2fed29-201a-4e15-a780-532c03191f10"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-plugged:dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-unplugged:4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-plugged:4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-unplugged:bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-plugged:bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-unplugged:135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-plugged:135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Creating event network-vif-unplugged:8a2fed29-201a-4e15-a780-532c03191f10 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1388 microversion: 2.1 time: 0.064152 Nov 14 02:11:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 109/325] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 14 02:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 1388 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "90c018ce-1c12-4cb8-9d98-070fd8a1810a"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Creating event network-vif-plugged:90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Nov 14 02:11:15 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 110/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "8a2fed29-201a-4e15-a780-532c03191f10"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Creating event network-vif-plugged:8a2fed29-201a-4e15-a780-532c03191f10 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045147 Nov 14 02:11:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 108/327] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:17 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42cdcf9f-848c-4960-87ca-3a8afa145b6a", "tag": "c975f85e-f764-4db8-a9e1-e07ca13ce937"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Creating event network-changed:c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a on user Nov 14 02:11:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035535 Nov 14 02:11:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 110/328] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-unplugged", "status": "completed", "tag": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Creating event network-vif-unplugged:02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.295828 Nov 14 02:11:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 111/329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-deleted", "tag": "8a2fed29-201a-4e15-a780-532c03191f10"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] Creating event network-vif-deleted:8a2fed29-201a-4e15-a780-532c03191f10 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043656 Nov 14 02:11:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 109/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-plugged", "status": "completed", "tag": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Creating event network-vif-plugged:02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047932 Nov 14 02:11:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:21 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cdcf9f-848c-4960-87ca-3a8afa145b6a", "name": "network-vif-plugged", "status": "completed", "tag": "c975f85e-f764-4db8-a9e1-e07ca13ce937"}, {"server_uuid": "42cdcf9f-848c-4960-87ca-3a8afa145b6a", "name": "network-vif-plugged", "status": "completed", "tag": "c975f85e-f764-4db8-a9e1-e07ca13ce937"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-deleted", "tag": "135ef6eb-a5e3-4537-b64f-404b6bca66f5"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-deleted", "tag": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1"}, {"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-deleted", "tag": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Creating event network-vif-plugged:c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a on user Nov 14 02:11:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Creating event network-vif-plugged:c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a on user Nov 14 02:11:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Creating event network-vif-deleted:135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Creating event network-vif-deleted:02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Creating event network-vif-deleted:bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.039472 Nov 14 02:11:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 112/332] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:21 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:24 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b2ae4729-4ae7-4d31-beb6-9d5c7d3021c7 req-27bb7253-043e-4ea7-aeb0-7248580f5772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889", "name": "network-vif-deleted", "tag": "dee8e8d1-721c-4209-8bd4-b0c873f68c66"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b2ae4729-4ae7-4d31-beb6-9d5c7d3021c7 req-27bb7253-043e-4ea7-aeb0-7248580f5772 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b2ae4729-4ae7-4d31-beb6-9d5c7d3021c7 req-27bb7253-043e-4ea7-aeb0-7248580f5772 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b2ae4729-4ae7-4d31-beb6-9d5c7d3021c7 req-27bb7253-043e-4ea7-aeb0-7248580f5772 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:24 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b2ae4729-4ae7-4d31-beb6-9d5c7d3021c7 req-27bb7253-043e-4ea7-aeb0-7248580f5772 service nova] Creating event network-vif-deleted:dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 on user Nov 14 02:11:24 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b2ae4729-4ae7-4d31-beb6-9d5c7d3021c7 req-27bb7253-043e-4ea7-aeb0-7248580f5772 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035298 Nov 14 02:11:24 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 110/333] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:30 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e4b834af-cc48-4c6f-a6d7-60d5fb883029 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1787028990", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b4727279-e3fe-492f-9bd4-ea72808f55c4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f3895747-ee7e-46a0-8759-2a4f3e01b728"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-e4b834af-cc48-4c6f-a6d7-60d5fb883029 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] HTTP exception thrown: Block Device b4727279-e3fe-492f-9bd4-ea72808f55c4 is not bootable. Nov 14 02:11:30 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e4b834af-cc48-4c6f-a6d7-60d5fb883029 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Returning 400 to user: Block Device b4727279-e3fe-492f-9bd4-ea72808f55c4 is not bootable. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:11:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e4b834af-cc48-4c6f-a6d7-60d5fb883029 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.073357 Nov 14 02:11:30 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 112/334] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:11:30 2023] POST /compute/v2.1/servers => generated 110 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:30 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:30 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c36290c6-dd3f-4b9e-9ebe-e6278a0068f1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 200 len: 1492 microversion: 2.1 time: 0.252325 Nov 14 02:11:30 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 113/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:30 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 1492 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:33 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-06673b43-69dc-4582-9717-6abed802a35a tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb29dc60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1349261540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCerez3qRud3tNAAT12b+t4i+0H7Sr5njhlCmhyMPjU2JaLT1djZUoYL1W2kD0Bsh7apkcxxkNW/Nd2lfcp9UJBVsonfsZCS9Q4VFC2iCaV+Xa1MxoJDOhjo3xsuwm5kw=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:33 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-06673b43-69dc-4582-9717-6abed802a35a tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for project 9cfe231fae1941f4970c17e344df8b81. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:11:33 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-06673b43-69dc-4582-9717-6abed802a35a tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for user 87f69eeadbaf45bfa01dfdfa5efcccb3 and project 9cfe231fae1941f4970c17e344df8b81. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:11:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-06673b43-69dc-4582-9717-6abed802a35a tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049359 Nov 14 02:11:33 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 111/336] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:11:33 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:33 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:33 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-550486898", "imageRef": "3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-1349261540", "networks": [{"uuid": "48fae5b7-e614-4e23-9424-98dec9f9eab6"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:33 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] validate_networks() for [('48fae5b7-e614-4e23-9424-98dec9f9eab6', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for project 9cfe231fae1941f4970c17e344df8b81. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for user 87f69eeadbaf45bfa01dfdfa5efcccb3 and project 9cfe231fae1941f4970c17e344df8b81. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:11:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:11:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.548560 Nov 14 02:11:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 113/337] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:11:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:11:34 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-96997bad-4427-4337-920e-fff4951e15d1 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:34 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-96997bad-4427-4337-920e-fff4951e15d1 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:34 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-96997bad-4427-4337-920e-fff4951e15d1 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:34 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-96997bad-4427-4337-920e-fff4951e15d1 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1250 microversion: 2.1 time: 0.059983 Nov 14 02:11:34 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 114/338] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:34 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1250 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=36 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-97260a13-351b-4dcf-8d29-9a497732e32d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.327499 Nov 14 02:11:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 112/339] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:11:35 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-interface => generated 282 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Creating event network-changed:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:11:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069489 Nov 14 02:11:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 114/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:36 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-97d89748-b486-415e-ac77-08a143648d53 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1542 microversion: 2.1 time: 0.219461 Nov 14 02:11:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 115/341] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:36 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1542 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Creating event network-changed:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:11:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036354 Nov 14 02:11:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340910 Nov 14 02:11:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 113/343] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:11:36 2023] POST /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-plugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Creating event network-vif-plugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:11:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052548 Nov 14 02:11:39 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 116/344] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:40 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'services' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:11:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-volume_attachments/399fd6d1-cc6f-432c-96c2-eb97da1c0ceb" status: 202 len: 0 microversion: 2.1 time: 0.522213 Nov 14 02:11:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 116/345] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:11:39 2023] DELETE /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-volume_attachments/399fd6d1-cc6f-432c-96c2-eb97da1c0ceb => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/action" status: 202 len: 0 microversion: 2.1 time: 0.204016 Nov 14 02:11:40 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 114/346] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:11:40 2023] POST /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9ad13b12-7550-4748-8ff4-27c339374aa4 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.196947 Nov 14 02:11:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 117/347] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:11:40 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-interface => generated 282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:41 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-unplugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Creating event network-vif-unplugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:11:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042495 Nov 14 02:11:41 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-plugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Creating event network-vif-plugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:11:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046419 Nov 14 02:11:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 115/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:41 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:41 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Creating event network-changed:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:11:41 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172857 Nov 14 02:11:41 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 118/350] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:11:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040197 Nov 14 02:11:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 118/351] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:43 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Creating event network-changed:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:11:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048671 Nov 14 02:11:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 116/352] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:44 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-4cd53563-8999-4a59-99e9-0bb461878abd tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1707 microversion: 2.1 time: 0.254857 Nov 14 02:11:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 119/353] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:44 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1707 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestOtherA-server-1571034706", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for project a1ba9547629f4ea1b40424e277e17d25. Resources: dict_keys(['metadata_items']) {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for user 7ffa5574e531479993ef301510f1d9e3 and project a1ba9547629f4ea1b40424e277e17d25. Resources: dict_keys(['metadata_items']) {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c4c19ead-88dc-4139-8542-4fc0d1a7ab38 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049320 Nov 14 02:11:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 117/354] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:11:45 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/action" status: 202 len: 1162 microversion: 2.1 time: 0.342718 Nov 14 02:11:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Nov 14 02:11:44 2023] POST /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/action => generated 1162 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}, {"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:11:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:11:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037353 Nov 14 02:11:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 120/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:11:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] HTTP exception thrown: Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb is not attached to volume f01f386a-4a49-4a3f-932c-f3bdd88a29a4 Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Returning 404 to user: Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb is not attached to volume f01f386a-4a49-4a3f-932c-f3bdd88a29a4 {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:11:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d5c99e38-966d-49e1-9e2f-136c7803d9ab tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4" status: 404 len: 154 microversion: 2.1 time: 0.155123 Nov 14 02:11:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:11:45 2023] DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb/os-volume_attachments/f01f386a-4a49-4a3f-932c-f3bdd88a29a4 => generated 154 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:11:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb" status: 204 len: 0 microversion: 2.1 time: 0.122516 Nov 14 02:11:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 121/358] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:11:45 2023] DELETE /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-07f2570a-ca65-4a82-9acf-04e6bba3e81c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1734 microversion: 2.1 time: 0.306215 Nov 14 02:11:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 118/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:45 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1734 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6df88a-5599-4b10-917c-c3c0b009c3cb", "name": "network-vif-unplugged", "status": "completed", "tag": "7946fb64-2722-4b7d-a7bc-5223ad6536e5"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:45 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c1fd3efa9a4997be00910265484154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b17ddccd4d7d82adbc420ad6adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-820ffca4-2868-48b6-80a1-db1b6200c52b tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb" status: 200 len: 1689 microversion: 2.1 time: 0.297477 Nov 14 02:11:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 121/360] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:45 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb => generated 1689 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Creating event network-vif-unplugged:7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb on user Nov 14 02:11:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050261 Nov 14 02:11:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 122/361] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6df88a-5599-4b10-917c-c3c0b009c3cb", "name": "network-vif-plugged", "status": "completed", "tag": "7946fb64-2722-4b7d-a7bc-5223ad6536e5"}, {"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-unplugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}, {"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-plugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}, {"server_uuid": "1a6df88a-5599-4b10-917c-c3c0b009c3cb", "name": "network-vif-deleted", "tag": "7946fb64-2722-4b7d-a7bc-5223ad6536e5"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Creating event network-vif-plugged:7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb on user Nov 14 02:11:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Creating event network-vif-unplugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:11:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Creating event network-vif-plugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:11:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Creating event network-vif-deleted:7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb on user Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.056844 Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 122/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:47 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] HTTP exception thrown: Instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe could not be found. Nov 14 02:11:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Returning 404 to user: Instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:11:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-005555cb-8065-41fe-9279-5fabec6d40a1 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe" status: 404 len: 111 microversion: 2.1 time: 0.178128 Nov 14 02:11:47 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 119/363] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:47 2023] GET /compute/v2.1/servers/907693ff-78a5-4fd7-8f75-c70f6186cbbe => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:50 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:11:50 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd" status: 204 len: 0 microversion: 2.1 time: 0.142320 Nov 14 02:11:50 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 123/364] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:11:50 2023] DELETE /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:50 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:11:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1f918531-237a-43db-91b5-c0a1483ac36b tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd" status: 200 len: 1668 microversion: 2.1 time: 0.362353 Nov 14 02:11:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 123/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:11:50 2023] GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:11:50 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd62b270-19d7-45e5-bd66-a94c384050bd", "name": "network-vif-unplugged", "status": "completed", "tag": "aa2867e8-4cfe-415e-96a1-881199b73c4c"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Creating event network-vif-unplugged:aa2867e8-4cfe-415e-96a1-881199b73c4c for instance fd62b270-19d7-45e5-bd66-a94c384050bd on user Nov 14 02:11:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038920 Nov 14 02:11:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 120/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:11:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd62b270-19d7-45e5-bd66-a94c384050bd", "name": "network-vif-deleted", "tag": "aa2867e8-4cfe-415e-96a1-881199b73c4c"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:52 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] Creating event network-vif-deleted:aa2867e8-4cfe-415e-96a1-881199b73c4c for instance fd62b270-19d7-45e5-bd66-a94c384050bd on user Nov 14 02:11:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052729 Nov 14 02:11:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd62b270-19d7-45e5-bd66-a94c384050bd", "name": "network-vif-plugged", "status": "completed", "tag": "aa2867e8-4cfe-415e-96a1-881199b73c4c"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Creating event network-vif-plugged:aa2867e8-4cfe-415e-96a1-881199b73c4c for instance fd62b270-19d7-45e5-bd66-a94c384050bd on user Nov 14 02:11:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034585 Nov 14 02:11:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 124/368] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-4dbcbd76-7cf4-45e1-89b9-f3da95cdd06d tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.220593 Nov 14 02:11:53 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 121/369] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:11:52 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-interface => generated 282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dc69db0-7870-47f5-893c-3a671a567673"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368419 Nov 14 02:11:54 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 125/370] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:11:54 2023] POST /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:54 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89aad70-7a33-4519-8308-f9ed98031692", "tag": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Creating event network-changed:4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance d89aad70-7a33-4519-8308-f9ed98031692 on user Nov 14 02:11:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027676 Nov 14 02:11:54 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:11:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-plugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:11:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:11:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:11:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:11:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:11:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Creating event network-vif-plugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:11:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032680 Nov 14 02:11:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 122/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:11:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:00 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-plugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:00 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Creating event network-vif-plugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:12:00 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038493 Nov 14 02:12:00 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 126/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:12:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "86f47159-12bc-4ff4-914f-c03163dcf3e6"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:03 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments/5dc69db0-7870-47f5-893c-3a671a567673" status: 202 len: 0 microversion: 2.1 time: 0.643078 Nov 14 02:12:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 126/374] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 14 02:12:02 2023] PUT /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments/5dc69db0-7870-47f5-893c-3a671a567673 => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:03 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Going to try to stop instance {{(pid=64866) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] HTTP exception thrown: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Returning 404 to user: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:12:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e57cb45d-688a-43e6-9ca7-d3b3a679ca06 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 404 len: 111 microversion: 2.42 time: 0.028563 Nov 14 02:12:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 127/375] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:12:03 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:12:03 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-cc00c039-5606-4981-825a-021d5c336f52 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '.version_select at 0x7fc9eb3f8790>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-cc00c039-5606-4981-825a-021d5c336f52 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397456095" status: 204 len: 0 microversion: 2.42 time: 0.091629 Nov 14 02:12:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action" status: 202 len: 0 microversion: 2.1 time: 0.222691 Nov 14 02:12:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 127/376] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 14 02:12:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397456095 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:12:03 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 123/377] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:12:02 2023] POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:03 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-61273ae6-9dd0-4272-8da3-5877721f9310 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1662 microversion: 2.1 time: 0.373013 Nov 14 02:12:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 128/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:03 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1662 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:12:03 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-unplugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:03 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:03 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:03 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Creating event network-vif-unplugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:12:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034798 Nov 14 02:12:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 128/379] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:12:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:05 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:05 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:05 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-02dd0957-1195-4e1e-be90-a59ec9eede57 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a" status: 200 len: 1690 microversion: 2.87 time: 0.375781 Nov 14 02:12:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 124/380] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:12:04 2023] GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a => generated 1690 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:12:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:12:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033668 Nov 14 02:12:05 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 129/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:12:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:06 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:06 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] HTTP exception thrown: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. Nov 14 02:12:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Returning 404 to user: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:12:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-82cb8159-178e-43fe-abe3-bbf1c127a8ea tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 404 len: 111 microversion: 2.42 time: 0.029523 Nov 14 02:12:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 129/382] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:12:06 2023] DELETE /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] HTTP exception thrown: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. Nov 14 02:12:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Returning 404 to user: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:12:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b2557782-d375-42da-8cb8-eb6975bf894c tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" status: 404 len: 111 microversion: 2.42 time: 0.033282 Nov 14 02:12:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 125/383] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:12:07 2023] GET /compute/v2.1/servers/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:13 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'services' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:12:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments/6a26d0df-3e86-4e5e-bd0d-5deae5534d5a" status: 202 len: 0 microversion: 2.1 time: 0.483228 Nov 14 02:12:13 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 130/384] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:12:13 2023] DELETE /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments/6a26d0df-3e86-4e5e-bd0d-5deae5534d5a => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:13 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-921b3406-3b4d-406d-b8ca-4d9e946deaba tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115086 Nov 14 02:12:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 130/385] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:12:13 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:16 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-8063864e-1d3a-45bb-bbf4-4e451b5499fb tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040868 Nov 14 02:12:16 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 126/386] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:12:16 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:16 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-4012a107-e633-4653-8618-d3dfd2a3c6fd tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042445 Nov 14 02:12:16 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 131/387] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:12:16 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5dc69db0-7870-47f5-893c-3a671a567673"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments/86f47159-12bc-4ff4-914f-c03163dcf3e6" status: 202 len: 0 microversion: 2.1 time: 0.292258 Nov 14 02:12:16 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 131/388] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 14 02:12:16 2023] PUT /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments/86f47159-12bc-4ff4-914f-c03163dcf3e6 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:24 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5e6cac59-d76b-44a2-a74b-c3a3f995ab04 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1535 microversion: 2.1 time: 0.534161 Nov 14 02:12:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 127/389] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:24 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1535 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=15 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=121,nova_cell1:INSERT=7,nova_cell1:UPDATE=10,nova_cell1:DELETE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1099099117", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] validate_networks() for [('49124b4f-3521-43c8-bda4-701f450c6b7d', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for user a5f8a4942cb54c9aa5377e6d2df1aa7b and project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:12:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:12:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.883106 Nov 14 02:12:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 132/390] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:12:26 2023] POST /compute/v2.1/servers => generated 381 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:12:27 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:27 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-682687bc-567d-4449-bc32-ad713cce27d5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:27 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-682687bc-567d-4449-bc32-ad713cce27d5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-682687bc-567d-4449-bc32-ad713cce27d5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-682687bc-567d-4449-bc32-ad713cce27d5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 200 len: 1214 microversion: 2.1 time: 0.121385 Nov 14 02:12:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 132/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:27 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-439193571", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] validate_networks() for [('49124b4f-3521-43c8-bda4-701f450c6b7d', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-96bf5472-1965-414d-bf88-37f426b78ddf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042755 Nov 14 02:12:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 133/392] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:12:28 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c067987d-664b-43fa-9d9a-8fcda2fc97bf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054900 Nov 14 02:12:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 133/393] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:12:28 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lazy-loading 'services' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for user a5f8a4942cb54c9aa5377e6d2df1aa7b and project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:12:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.573361 Nov 14 02:12:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 128/394] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:12:28 2023] POST /compute/v2.1/servers => generated 381 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:12:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments/5dc69db0-7870-47f5-893c-3a671a567673" status: 202 len: 0 microversion: 2.1 time: 0.199371 Nov 14 02:12:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 134/395] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:12:28 2023] DELETE /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments/5dc69db0-7870-47f5-893c-3a671a567673 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-2e61984f-6a29-4c2f-999b-b174c73de48f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2e61984f-6a29-4c2f-999b-b174c73de48f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-3bc87e8b-ea11-487d-b591-db98d10383a4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Nov 14 02:12:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 129/396] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:12:28 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:28 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-2e61984f-6a29-4c2f-999b-b174c73de48f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-2e61984f-6a29-4c2f-999b-b174c73de48f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e" status: 200 len: 1213 microversion: 2.1 time: 0.066294 Nov 14 02:12:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 134/397] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:28 2023] GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:12:30 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Creating event network-changed:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:12:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029750 Nov 14 02:12:30 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 135/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:30 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:30 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-01995634-4cc3-4606-a8a3-ad7dd630caa1 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 200 len: 1492 microversion: 2.1 time: 0.266458 Nov 14 02:12:30 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 130/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:30 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 1492 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:12:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Creating event network-changed:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:12:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030927 Nov 14 02:12:31 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:12:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:12:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112628 Nov 14 02:12:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 136/401] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:35 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-ab51c212-e91a-4231-8d1c-04d7b96c7104 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1725 microversion: 2.1 time: 0.204162 Nov 14 02:12:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 131/402] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:35 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] HTTP exception thrown: Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb could not be found. Nov 14 02:12:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Returning 404 to user: Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:12:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-dcd3284b-d9ed-4863-9dc5-58d3871f27dc tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb" status: 404 len: 111 microversion: 2.1 time: 0.033755 Nov 14 02:12:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 136/403] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:35 2023] GET /compute/v2.1/servers/1a6df88a-5599-4b10-917c-c3c0b009c3cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:12:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b2677d67-219f-4bbb-b179-e1beff4fae7e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Calling method '.version_select at 0x7fc9eb2280d0>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b2677d67-219f-4bbb-b179-e1beff4fae7e tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309882152" status: 202 len: 0 microversion: 2.1 time: 0.030403 Nov 14 02:12:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 137/404] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:12:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309882152 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:12:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}, {"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-plugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}, {"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-plugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:12:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Creating event network-vif-plugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:12:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Creating event network-vif-plugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:12:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033505 Nov 14 02:12:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 132/405] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:12:36 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] HTTP exception thrown: Instance fd62b270-19d7-45e5-bd66-a94c384050bd could not be found. Nov 14 02:12:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Returning 404 to user: Instance fd62b270-19d7-45e5-bd66-a94c384050bd could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:12:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c7b728b3-e6b3-47c7-8c9f-956b0073cde0 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd" status: 404 len: 111 microversion: 2.1 time: 0.037798 Nov 14 02:12:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:40 2023] GET /compute/v2.1/servers/fd62b270-19d7-45e5-bd66-a94c384050bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:12:40 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:40 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3afd7a2a-a019-4afc-97dc-18a47259d203 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Calling method '.version_select at 0x7fc9eb4cb880>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-3afd7a2a-a019-4afc-97dc-18a47259d203 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368640699" status: 202 len: 0 microversion: 2.1 time: 0.030639 Nov 14 02:12:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 138/407] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:12:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368640699 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=7 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:53 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-45b091e8-bcd1-4490-87b3-4f467dddd23e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1639 microversion: 2.1 time: 0.340487 Nov 14 02:12:53 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 133/408] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:53 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1639 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:12:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=16 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=12 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c8221369-1f08-4497-9647-8efb1accdda3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb3f9750>, body: {"keypair": {"name": "tempest-keypair-1362037621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:57 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-c8221369-1f08-4497-9647-8efb1accdda3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting quotas for project 5dcd87f632574f81813bc7606a8fe70e. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:12:57 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-c8221369-1f08-4497-9647-8efb1accdda3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting quotas for user b73fe859f2604a1bbf70f01587cf015c and project 5dcd87f632574f81813bc7606a8fe70e. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:12:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c8221369-1f08-4497-9647-8efb1accdda3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096425 Nov 14 02:12:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 138/409] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:12:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:12:58 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:58 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:12:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherB-server-164252655", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e441a460-c10e-447c-ac80-93a89d0eff62"}], "security_groups": [{"name": "tempest-securitygroup--24831473"}], "key_name": "tempest-keypair-1362037621", "user_data": "}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] validate_networks() for [('e441a460-c10e-447c-ac80-93a89d0eff62', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting quotas for project 5dcd87f632574f81813bc7606a8fe70e. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting quotas for user b73fe859f2604a1bbf70f01587cf015c and project 5dcd87f632574f81813bc7606a8fe70e. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:12:59 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:12:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824766 Nov 14 02:12:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 139/410] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:12:58 2023] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:12:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6b121348-af91-4346-9943-2ef1f4ea691c tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:12:59 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6b121348-af91-4346-9943-2ef1f4ea691c tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:12:59 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-6b121348-af91-4346-9943-2ef1f4ea691c tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:12:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6b121348-af91-4346-9943-2ef1f4ea691c tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1232 microversion: 2.1 time: 0.068833 Nov 14 02:12:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 134/411] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:12:59 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1232 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-64d0c1d8-f4bb-4ab3-a2a2-905b0c7997fd tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb2a5d80>, body: {"keypair": {"name": "tempest-TestStampPattern-863039138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29cl1fr1mQddCmz0NjRlHZtGI31Z/HpB+Nsx3OGKzEmi6USs0zIOlWO+VML9vORCyVCO+2Wn/r9l3Z21RvN0BLUGIBRfBmYCbzP7P30tWvVkVZygqVIesWMX0qe0GeCw=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:02 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-64d0c1d8-f4bb-4ab3-a2a2-905b0c7997fd tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting quotas for project fbfae642569847a2a3ac4cd4066aeb22. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:13:02 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-64d0c1d8-f4bb-4ab3-a2a2-905b0c7997fd tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting quotas for user 089b000c028b46b998f2c128a6cf3d0a and project fbfae642569847a2a3ac4cd4066aeb22. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:13:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-64d0c1d8-f4bb-4ab3-a2a2-905b0c7997fd tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.220170 Nov 14 02:13:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 139/412] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:13:02 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Creating event network-changed:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:13:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037681 Nov 14 02:13:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 140/413] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-15b4f59a-19ea-4e4c-92ec-7dde3b922752 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047229 Nov 14 02:13:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 135/414] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:13:04 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-887301658", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "key_name": "tempest-TestStampPattern-863039138", "security_groups": [{"name": "tempest-secgroup-smoke-324289811"}], "networks": [{"uuid": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-51687956-5623-46dc-bc2c-be775a6630e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '.version_select at 0x7fc9eb3776d0>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] validate_networks() for [('3cb79e37-ec0c-4195-8ad1-f968e55a48dd', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:13:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-51687956-5623-46dc-bc2c-be775a6630e0 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239" status: 204 len: 0 microversion: 2.1 time: 0.323611 Nov 14 02:13:04 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 141/415] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:04 2023] DELETE /compute/v2.1/images/b509ff61-3da4-44ab-b845-45e446a66239 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:13:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 204 len: 0 microversion: 2.1 time: 0.138494 Nov 14 02:13:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 136/416] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:13:04 2023] DELETE /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting quotas for project fbfae642569847a2a3ac4cd4066aeb22. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting quotas for user 089b000c028b46b998f2c128a6cf3d0a and project fbfae642569847a2a3ac4cd4066aeb22. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:13:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.628092 Nov 14 02:13:04 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 140/417] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:13:04 2023] POST /compute/v2.1/servers => generated 403 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-9aed80c0-14d2-4c16-bcae-d6a49f197c49 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-9aed80c0-14d2-4c16-bcae-d6a49f197c49 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:04 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-9aed80c0-14d2-4c16-bcae-d6a49f197c49 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-9aed80c0-14d2-4c16-bcae-d6a49f197c49 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639" status: 200 len: 1233 microversion: 2.1 time: 0.131007 Nov 14 02:13:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 137/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:04 2023] GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639 => generated 1233 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:04 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-unplugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-dbd2316d-167d-4c51-a636-68df62da362e tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 200 len: 1677 microversion: 2.1 time: 0.281376 Nov 14 02:13:04 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 142/419] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:04 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Creating event network-vif-unplugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:13:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042677 Nov 14 02:13:04 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 141/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-657494516"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a/action" status: 202 len: 52 microversion: 2.87 time: 1.050975 Nov 14 02:13:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 138/421] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:13:05 2023] POST /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a/action => generated 52 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:13:06 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-deleted", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:06 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] Creating event network-vif-deleted:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:13:06 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035913 Nov 14 02:13:06 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 143/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b5a6d0-1304-49c1-90fb-5964d56885c8", "name": "network-vif-plugged", "status": "completed", "tag": "8fe0bc37-945a-433d-8dd0-43514dce6f99"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Creating event network-vif-plugged:8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 on user Nov 14 02:13:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049479 Nov 14 02:13:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 142/423] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}, {"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:13:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:13:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049875 Nov 14 02:13:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 139/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:13:09 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Creating event network-changed:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:13:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036998 Nov 14 02:13:09 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 144/425] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "name": "network-vif-plugged", "status": "completed", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Creating event network-vif-plugged:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:13:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Nov 14 02:13:09 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 143/426] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "name": "network-vif-plugged", "status": "completed", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Creating event network-vif-plugged:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:13:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030563 Nov 14 02:13:12 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 140/427] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:13 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-dd74b6b9-2a68-4431-bb62-d0c5bb43cda6 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a" status: 200 len: 1690 microversion: 2.87 time: 0.241275 Nov 14 02:13:13 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 145/428] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:13:13 2023] GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=14 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b8b451f2-3748-4666-82e9-034b35b46abf tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048450 Nov 14 02:13:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 144/429] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:13:18 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:19 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:13:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c7b5dad0-a08a-44d5-9af7-05062d115d95 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e" status: 200 len: 1502 microversion: 2.1 time: 0.209593 Nov 14 02:13:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 141/430] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:18 2023] GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:13:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692" status: 204 len: 0 microversion: 2.1 time: 0.115423 Nov 14 02:13:19 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 146/431] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:13:19 2023] DELETE /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89aad70-7a33-4519-8308-f9ed98031692", "name": "network-vif-unplugged", "status": "completed", "tag": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '817e73cf3aab4227baee2a818261aa41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ac0058ef794b9b860bf77eec4e6ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Creating event network-vif-unplugged:4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance d89aad70-7a33-4519-8308-f9ed98031692 on user Nov 14 02:13:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-30e0fbec-052f-42fb-82bf-424be309c6e4 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692" status: 200 len: 1646 microversion: 2.1 time: 0.279541 Nov 14 02:13:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 145/432] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:19 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692 => generated 1646 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034516 Nov 14 02:13:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 142/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:21 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89aad70-7a33-4519-8308-f9ed98031692", "name": "network-vif-plugged", "status": "completed", "tag": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084"}, {"server_uuid": "d89aad70-7a33-4519-8308-f9ed98031692", "name": "network-vif-deleted", "tag": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Creating event network-vif-plugged:4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance d89aad70-7a33-4519-8308-f9ed98031692 on user Nov 14 02:13:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Creating event network-vif-deleted:4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance d89aad70-7a33-4519-8308-f9ed98031692 on user Nov 14 02:13:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039832 Nov 14 02:13:21 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 147/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:25 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:25 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-41cd142f-d25d-4533-ace4-925d872652c4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1535 microversion: 2.1 time: 0.322083 Nov 14 02:13:25 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 146/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:25 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1535 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching by: {'deleted': False, 'project_id': '9cfe231fae1941f4970c17e344df8b81'} {{(pid=64866) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:25 user devstack@n-api.service[64866]: DEBUG nova.compute.multi_cell_list [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64866) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 14 02:13:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b2cca3a3-636c-4f55-bb71-65de155181dc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.063197 Nov 14 02:13:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 143/436] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 14 02:13:25 2023] GET /compute/v2.1/servers => generated 340 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:25 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f8200f6a-c88c-41d4-8804-1be12acbbdc8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1535 microversion: 2.1 time: 0.242625 Nov 14 02:13:25 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 148/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:25 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1535 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ae6554c-749e-436f-b233-36c7d3784082"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286771 Nov 14 02:13:27 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 147/438] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:13:27 2023] POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:13:32 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7e01585b-9c5e-497d-9e37-912dfd4947cb tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1978078520", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "destination_type": "local"}, {"source_type": "volume", "uuid": "934c9b15-a9d0-4ee3-b07e-a8ce244b00c2", "destination_type": "invalid"}], "networks": [{"uuid": "f3895747-ee7e-46a0-8759-2a4f3e01b728"}]}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:32 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7e01585b-9c5e-497d-9e37-912dfd4947cb tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:13:32 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7e01585b-9c5e-497d-9e37-912dfd4947cb tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.008110 Nov 14 02:13:32 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 144/439] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:13:32 2023] POST /compute/v2.1/servers => generated 155 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:32 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:32 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6ac51f00-6e73-4784-a056-0d444fdff926 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 200 len: 1492 microversion: 2.1 time: 0.215673 Nov 14 02:13:32 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 149/440] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:32 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 1492 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:35 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-78c18417-045b-473e-bc03-d806709a0815 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1581 microversion: 2.1 time: 0.227626 Nov 14 02:13:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 148/441] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:35 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1581 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:36 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b53f4879-3c4e-4f9a-9ca4-a95aec70d7f8 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1725 microversion: 2.1 time: 0.227905 Nov 14 02:13:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 145/442] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:35 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:36 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-0c249bf7-5b9b-4276-991e-0b0c771a84f1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1659 microversion: 2.1 time: 0.150307 Nov 14 02:13:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 150/443] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:36 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1659 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Creating event network-changed:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:13:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032988 Nov 14 02:13:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 149/444] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-984114335"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:39 user devstack@n-api.service[64866]: INFO nova.network.security_group_api [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Adding security group a6ca7ab3-1ead-4b19-9aec-bf1fc6df62ee to port de607b68-f250-49c9-ac97-489a341f5963 Nov 14 02:13:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a739aed5-d072-4df9-b22b-e62aad281bc3 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/action" status: 202 len: 0 microversion: 2.1 time: 0.557355 Nov 14 02:13:39 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 146/445] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:13:39 2023] POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Creating event network-changed:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:13:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027783 Nov 14 02:13:39 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 150/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:39 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:39 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-13f05dd5-fff1-440e-818f-7a085166d6ae tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1746 microversion: 2.1 time: 0.182394 Nov 14 02:13:39 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 151/447] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:39 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/action" status: 202 len: 0 microversion: 2.1 time: 0.095565 Nov 14 02:13:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 147/448] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:13:41 2023] POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:41 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:41 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-4ea21837-5a46-420d-9421-f4cf5b253a85 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1748 microversion: 2.1 time: 0.228935 Nov 14 02:13:41 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 151/449] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:41 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1748 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-unplugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Creating event network-vif-unplugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:13:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028612 Nov 14 02:13:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 152/450] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-plugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Creating event network-vif-plugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:13:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028310 Nov 14 02:13:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 148/451] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-plugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Creating event network-vif-plugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:13:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046758 Nov 14 02:13:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 152/452] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-plugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Creating event network-vif-plugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:13:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030683 Nov 14 02:13:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 153/453] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:50 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-edd9f528-2ded-4526-ab61-22861b312007 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1540 microversion: 2.1 time: 0.196410 Nov 14 02:13:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 149/454] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:49 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1540 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:54 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:54 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Going to try to start instance {{(pid=64868) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 14 02:13:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action" status: 202 len: 0 microversion: 2.1 time: 0.117857 Nov 14 02:13:54 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 153/455] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:13:54 2023] POST /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:54 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2c012750-6203-4614-a8d7-e8057331a1cf tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1648 microversion: 2.1 time: 0.209349 Nov 14 02:13:54 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:54 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1648 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:55 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] HTTP exception thrown: Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 could not be found. Nov 14 02:13:55 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Returning 404 to user: Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:13:55 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ec8d9ccb-a73c-41e2-af77-e1f8d4eb3bb9 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8" status: 404 len: 111 microversion: 2.1 time: 0.027963 Nov 14 02:13:55 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 154/457] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:55 2023] GET /compute/v2.1/servers/b9b5a6d0-1304-49c1-90fb-5964d56885c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:13:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e98766fd-573f-4342-8f81-e30aa6110a76 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Calling method '.version_select at 0x7fc9eb377130>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:13:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e98766fd-573f-4342-8f81-e30aa6110a76 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863826463" status: 202 len: 0 microversion: 2.1 time: 0.027346 Nov 14 02:13:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 155/458] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:13:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863826463 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:13:55 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:13:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-383eca14-4359-4778-8a59-32a833f7c213 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639" status: 200 len: 1533 microversion: 2.1 time: 0.344050 Nov 14 02:13:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 150/459] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:13:54 2023] GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639 => generated 1533 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:13:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:13:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051966 Nov 14 02:13:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 155/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:13:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-plugged", "status": "completed", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:13:59 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:13:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:13:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:13:59 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:13:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Creating event network-vif-plugged:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:13:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035330 Nov 14 02:13:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 156/461] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:03 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d3f22c25-3f58-4cb0-917d-dd84566d27a2 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb29c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1181338866", "metadata": {"Type": "work"}}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d3f22c25-3f58-4cb0-917d-dd84566d27a2 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.449076 Nov 14 02:14:03 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 151/462] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 14 02:14:03 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 450 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 14 02:14:03 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0ebb3594-0b53-465d-b08a-0d81f01dd0ac tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Calling method '.version_select at 0x7fc9eb4a1120>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0ebb3594-0b53-465d-b08a-0d81f01dd0ac tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6" status: 200 len: 353 microversion: 2.1 time: 0.057876 Nov 14 02:14:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 156/463] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:14:03 2023] GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3eff0f9b-d520-4df1-8d7a-15a82afd00a3 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Calling method '.version_select at 0x7fc9eb4c85e0>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-3eff0f9b-d520-4df1-8d7a-15a82afd00a3 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6" status: 200 len: 354 microversion: 2.1 time: 0.051330 Nov 14 02:14:04 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 157/464] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:14:04 2023] GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e45503b6-a45b-423b-8c3b-8bc400e77676 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Calling method '.version_select at 0x7fc9eb4f83a0>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e45503b6-a45b-423b-8c3b-8bc400e77676 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6" status: 200 len: 354 microversion: 2.1 time: 0.052414 Nov 14 02:14:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 152/465] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:14:04 2023] GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-eebc115d-7a16-4d52-a9a7-a7a0f7de15b0 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Calling method '.version_select at 0x7fc9eb2a7640>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-eebc115d-7a16-4d52-a9a7-a7a0f7de15b0 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6" status: 202 len: 0 microversion: 2.1 time: 0.082669 Nov 14 02:14:04 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 157/466] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:14:04 2023] DELETE /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:14:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9e386c34-9c7c-47e1-bb58-3e621bcbee02 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Calling method '.version_select at 0x7fc9eb690700>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9e386c34-9c7c-47e1-bb58-3e621bcbee02 tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6" status: 200 len: 353 microversion: 2.1 time: 0.052378 Nov 14 02:14:04 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 158/467] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:14:04 2023] GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:05 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=12 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:05 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d8bddda9-4377-4e2a-8247-4e50f123c12d tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Calling method '.version_select at 0x7fc9eb29e320>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-d8bddda9-4377-4e2a-8247-4e50f123c12d tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] HTTP exception thrown: Volume 32af6ee2-11a3-4032-9d1b-7d295c16dda6 could not be found. Nov 14 02:14:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d8bddda9-4377-4e2a-8247-4e50f123c12d tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] Returning 404 to user: Volume 32af6ee2-11a3-4032-9d1b-7d295c16dda6 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:14:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d8bddda9-4377-4e2a-8247-4e50f123c12d tempest-VolumesGetTestJSON-558510803 tempest-VolumesGetTestJSON-558510803-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6" status: 404 len: 109 microversion: 2.1 time: 0.037927 Nov 14 02:14:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 153/468] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:14:05 2023] GET /compute/v2.1/os-volumes/32af6ee2-11a3-4032-9d1b-7d295c16dda6 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=5 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] HTTP exception thrown: Instance d89aad70-7a33-4519-8308-f9ed98031692 could not be found. Nov 14 02:14:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Returning 404 to user: Instance d89aad70-7a33-4519-8308-f9ed98031692 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:14:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-999c2ce1-e01a-492b-be49-952f14b874c5 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692" status: 404 len: 111 microversion: 2.1 time: 0.035588 Nov 14 02:14:09 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 158/469] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:09 2023] GET /compute/v2.1/servers/d89aad70-7a33-4519-8308-f9ed98031692 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:14:09 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a83443cc-9bf9-4736-807e-2e849732f51f tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Calling method '.version_select at 0x7fc9eb22bac0>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a83443cc-9bf9-4736-807e-2e849732f51f tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343931820" status: 202 len: 0 microversion: 2.1 time: 0.021716 Nov 14 02:14:09 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 159/470] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:14:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343931820 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:14:13 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1905828341", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "02278215-38bd-499d-a1ab-1d2bb873b0ee"}]}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] validate_networks() for [('02278215-38bd-499d-a1ab-1d2bb873b0ee', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for user addcfdac50de4b03bd3ad3142508edea and project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:14:14 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:14:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.456857 Nov 14 02:14:14 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 154/471] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:14:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:14:14 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c2cee453-29cc-4509-986c-b0c7d21d9d98 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:14 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c2cee453-29cc-4509-986c-b0c7d21d9d98 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:14 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c2cee453-29cc-4509-986c-b0c7d21d9d98 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:14 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c2cee453-29cc-4509-986c-b0c7d21d9d98 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:14 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c2cee453-29cc-4509-986c-b0c7d21d9d98 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c2cee453-29cc-4509-986c-b0c7d21d9d98 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 200 len: 1395 microversion: 2.87 time: 0.072650 Nov 14 02:14:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 159/472] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:14:14 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 1395 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:14:17 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:17 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Creating event network-changed:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:14:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037670 Nov 14 02:14:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 160/473] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:19 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:14:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e/action" status: 200 len: 32 microversion: 2.1 time: 0.154139 Nov 14 02:14:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 155/474] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:14:19 2023] POST /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-40fec86d-921e-4172-890d-2c4334ecddb8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e" status: 200 len: 1508 microversion: 2.1 time: 0.471250 Nov 14 02:14:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 160/475] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:19 2023] GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e => generated 1508 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:14:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-unplugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Creating event network-vif-unplugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:14:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035243 Nov 14 02:14:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 161/476] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:22 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-plugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Creating event network-vif-plugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:14:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048180 Nov 14 02:14:22 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 156/477] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:24 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-plugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}, {"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-plugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Creating event network-vif-plugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:14:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Creating event network-vif-plugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:14:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053210 Nov 14 02:14:24 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 161/478] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:29 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:14:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036033 Nov 14 02:14:29 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 162/479] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:14:31 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:31 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:31 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:31 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:14:31 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037308 Nov 14 02:14:31 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 157/480] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:32 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-8e24dad8-db32-4767-bf4b-b37a05650fd8 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1746 microversion: 2.1 time: 0.445320 Nov 14 02:14:32 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 162/481] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:31 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1746 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] HTTP exception thrown: Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 could not be found. Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Returning 404 to user: Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:14:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f41ca79a-4de1-482f-aa40-62fbf78937b3 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19" status: 404 len: 111 microversion: 2.1 time: 0.044219 Nov 14 02:14:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 163/482] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:14:36 2023] DELETE /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] HTTP exception thrown: Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 could not be found. Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Returning 404 to user: Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:14:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7b1fe973-0da1-45ef-bc35-dc568e7dec88 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19" status: 404 len: 111 microversion: 2.1 time: 0.032361 Nov 14 02:14:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 158/483] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:36 2023] GET /compute/v2.1/servers/b950c25e-2910-4de3-a9fc-30e4091dfe19 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:14:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 204 len: 0 microversion: 2.1 time: 0.124460 Nov 14 02:14:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 163/484] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:14:36 2023] DELETE /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-38112ba2-cd00-4014-9b59-4cf1ea059643 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 200 len: 1498 microversion: 2.1 time: 0.272583 Nov 14 02:14:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 164/485] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:36 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 1498 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:37 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'services' on Instance uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9df98c-7814-419d-8821-d8c571972f0e", "name": "network-vif-unplugged", "status": "completed", "tag": "592113b0-b777-4a01-ac6c-d5337e7d773a"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Creating event network-vif-unplugged:592113b0-b777-4a01-ac6c-d5337e7d773a for instance 2f9df98c-7814-419d-8821-d8c571972f0e on user Nov 14 02:14:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049175 Nov 14 02:14:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 164/486] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments/57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1" status: 202 len: 0 microversion: 2.1 time: 0.538697 Nov 14 02:14:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 159/487] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:14:36 2023] DELETE /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments/57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f1ae1047-6fde-4169-8a33-ef149f459a26 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078004 Nov 14 02:14:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 165/488] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:14:37 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-77b1730c-e92c-43fe-946a-a72481fea56e req-ada8b562-89a0-4c98-9932-28ed6d457a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9df98c-7814-419d-8821-d8c571972f0e", "name": "network-vif-deleted", "tag": "592113b0-b777-4a01-ac6c-d5337e7d773a"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-77b1730c-e92c-43fe-946a-a72481fea56e req-ada8b562-89a0-4c98-9932-28ed6d457a14 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-77b1730c-e92c-43fe-946a-a72481fea56e req-ada8b562-89a0-4c98-9932-28ed6d457a14 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-77b1730c-e92c-43fe-946a-a72481fea56e req-ada8b562-89a0-4c98-9932-28ed6d457a14 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-77b1730c-e92c-43fe-946a-a72481fea56e req-ada8b562-89a0-4c98-9932-28ed6d457a14 service nova] Creating event network-vif-deleted:592113b0-b777-4a01-ac6c-d5337e7d773a for instance 2f9df98c-7814-419d-8821-d8c571972f0e on user Nov 14 02:14:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-77b1730c-e92c-43fe-946a-a72481fea56e req-ada8b562-89a0-4c98-9932-28ed6d457a14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038868 Nov 14 02:14:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 165/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:39 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9df98c-7814-419d-8821-d8c571972f0e", "name": "network-vif-plugged", "status": "completed", "tag": "592113b0-b777-4a01-ac6c-d5337e7d773a"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:39 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Creating event network-vif-plugged:592113b0-b777-4a01-ac6c-d5337e7d773a for instance 2f9df98c-7814-419d-8821-d8c571972f0e on user Nov 14 02:14:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029644 Nov 14 02:14:39 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 160/490] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:44 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e0f650fd-c29b-49e4-8af1-5bb9ec1586c4 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1652 microversion: 2.1 time: 0.306626 Nov 14 02:14:44 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 166/491] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:44 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1652 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:14:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-4fc352cf-cf2d-4fc1-afde-36935f91d8f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb4a11b0>, body: {"keypair": {"name": "tempest-keypair-215674162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:45 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-4fc352cf-cf2d-4fc1-afde-36935f91d8f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting quotas for project 9e1d90f2eaae4b19883b23e8aaa8f47a. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:14:45 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-4fc352cf-cf2d-4fc1-afde-36935f91d8f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting quotas for user e82c04681c164b6fb997c0f97e9c77ec and project 9e1d90f2eaae4b19883b23e8aaa8f47a. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:14:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-4fc352cf-cf2d-4fc1-afde-36935f91d8f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.062859 Nov 14 02:14:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 166/492] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 14 02:14:45 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:14:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1744950715", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "f4b66683-d156-4859-8b77-bbcee566de49"}, {"port": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "tag": "port-1"}, {"port": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "tag": "port-2"}, {"uuid": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "tag": "net-1"}, {"uuid": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78"}, {"uuid": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "42dbd7d9-2083-4d89-be08-66361918c52d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9dfc9d29-0d9c-406b-bc49-d31ed7396b22", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "82b62c9e-80a8-43bc-b6ec-67fffaff059a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1349025017"}], "key_name": "tempest-keypair-215674162", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:46 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] validate_networks() for [('f4b66683-d156-4859-8b77-bbcee566de49', None, None, None, None, None), (None, None, 'f4ac726b-9912-4b5f-b751-3ca0a0621e09', None, None, None), (None, None, '4c7870e4-5a12-40e6-a06c-e635347f66f5', None, None, None), ('ae0b74b3-6290-47c9-91d3-7c1a60fa5c78', None, None, None, None, None), ('ae0b74b3-6290-47c9-91d3-7c1a60fa5c78', None, None, None, None, None), ('9bab567c-81ae-4eb6-b1d2-347bd1be854d', '10.2.2.100', None, None, None, None), ('9bab567c-81ae-4eb6-b1d2-347bd1be854d', '10.2.2.200', None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting quotas for project 9e1d90f2eaae4b19883b23e8aaa8f47a. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting quotas for user e82c04681c164b6fb997c0f97e9c77ec and project 9e1d90f2eaae4b19883b23e8aaa8f47a. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:14:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='42dbd7d9-2083-4d89-be08-66361918c52d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9dfc9d29-0d9c-406b-bc49-d31ed7396b22',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82b62c9e-80a8-43bc-b6ec-67fffaff059a',volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:14:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 2.717359 Nov 14 02:14:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 161/493] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 14 02:14:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 2719 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:14:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-87438da6-f971-4b8d-b54a-4dc685c5dd24 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-87438da6-f971-4b8d-b54a-4dc685c5dd24 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:49 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-87438da6-f971-4b8d-b54a-4dc685c5dd24 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:49 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-87438da6-f971-4b8d-b54a-4dc685c5dd24 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:49 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-87438da6-f971-4b8d-b54a-4dc685c5dd24 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-87438da6-f971-4b8d-b54a-4dc685c5dd24 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 200 len: 1277 microversion: 2.32 time: 0.078585 Nov 14 02:14:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 167/494] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:14:49 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 1277 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-429944f6-fd78-43ea-8eef-3c1a2a102b3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.461505 Nov 14 02:14:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 167/495] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:14:50 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/os-interface => generated 283 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Creating event network-changed:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:14:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033706 Nov 14 02:14:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 162/496] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:51 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c37170f1-2ec7-4480-aed5-09d727ac2bcb tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1540 microversion: 2.1 time: 0.367018 Nov 14 02:14:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 168/497] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:51 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1540 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:51 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-5f027998-11f9-44a7-adf0-22fce215a4c6 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1540 microversion: 2.1 time: 0.205526 Nov 14 02:14:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 168/498] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:51 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1540 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "531edd6a-d4a2-4d1a-a02d-e5efa760b394"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Creating event network-changed:531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:14:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036058 Nov 14 02:14:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 169/499] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:55 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:14:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-dbdcbbc4-75e9-4778-9dbf-462207e78139 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639" status: 200 len: 1533 microversion: 2.1 time: 0.561543 Nov 14 02:14:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 163/500] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:14:55 2023] GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639 => generated 1533 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:14:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "f4ac726b-9912-4b5f-b751-3ca0a0621e09"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:14:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Creating event network-changed:f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:14:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040020 Nov 14 02:14:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 169/501] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Creating event network-changed:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:14:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035154 Nov 14 02:14:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 170/502] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "490a80de-6c27-4e49-b5d1-5fcbfffa3f34"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333398 Nov 14 02:14:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 164/503] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:14:58 2023] POST /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:14:59 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "4c7870e4-5a12-40e6-a06c-e635347f66f5"}, {"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "f3041f35-502b-4bb9-9e73-13fe8aa11484"}, {"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "e3b64855-b03b-4ee1-8c89-6e3abc178faa"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:14:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:14:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:14:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:14:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Creating event network-changed:4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:14:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Creating event network-changed:f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:14:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Creating event network-changed:e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:14:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.055660 Nov 14 02:14:59 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 170/504] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:15:01 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:01 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "f13dd1ab-e475-40ad-a7d9-18d96362a10d"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Creating event network-changed:f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041132 Nov 14 02:15:01 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 171/505] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:03 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:03 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:03 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "e2acc9ad-f868-4e07-83c4-b87a1f08e670"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Creating event network-changed:e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034085 Nov 14 02:15:03 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 165/506] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:04 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-77c5ef6f-76d5-484b-983b-2734425bd2c7 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 200 len: 1768 microversion: 2.87 time: 0.282586 Nov 14 02:15:04 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 171/507] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:15:04 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 1768 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1951903037", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "c55f3a07-6ed6-4529-a229-3f3ce92e8bc1", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "82975375-7a5b-4666-9ca1-d92490943dd9"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] validate_networks() for [('82975375-7a5b-4666-9ca1-d92490943dd9', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:15:05 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c55f3a07-6ed6-4529-a229-3f3ce92e8bc1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:15:06 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.551322 Nov 14 02:15:06 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 172/508] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:15:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:15:06 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ad6cf3d3-3128-40af-8bf7-074cc573eb80 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:06 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-ad6cf3d3-3128-40af-8bf7-074cc573eb80 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:06 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-ad6cf3d3-3128-40af-8bf7-074cc573eb80 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-ad6cf3d3-3128-40af-8bf7-074cc573eb80 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 200 len: 1050 microversion: 2.1 time: 0.063326 Nov 14 02:15:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 166/509] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:06 2023] GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 1050 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:08 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'services' on Instance uuid c226a1bf-4b89-49e0-ad8f-149849f12639 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:15:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments/490a80de-6c27-4e49-b5d1-5fcbfffa3f34" status: 202 len: 0 microversion: 2.1 time: 0.214234 Nov 14 02:15:08 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 172/510] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:15:07 2023] DELETE /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments/490a80de-6c27-4e49-b5d1-5fcbfffa3f34 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-877a8936-8805-4c67-9bf7-002b499e32f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061523 Nov 14 02:15:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 173/511] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:15:08 2023] GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f", "tag": "03336681-82cb-4a6f-b9a2-f429ade55494"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:08 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Creating event network-changed:03336681-82cb-4a6f-b9a2-f429ade55494 for instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f on user Nov 14 02:15:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032048 Nov 14 02:15:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 167/512] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:10 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-701475b6-e7d5-462e-8b26-5fdcee2c1fea tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e" status: 200 len: 1488 microversion: 2.1 time: 0.201421 Nov 14 02:15:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 173/513] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:09 2023] GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e => generated 1488 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:15:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "531edd6a-d4a2-4d1a-a02d-e5efa760b394"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Creating event network-vif-plugged:531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048228 Nov 14 02:15:13 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 174/514] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:13 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "4c7870e4-5a12-40e6-a06c-e635347f66f5"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Creating event network-vif-plugged:4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036968 Nov 14 02:15:13 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 168/515] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:14 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f13dd1ab-e475-40ad-a7d9-18d96362a10d"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Creating event network-vif-plugged:f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038762 Nov 14 02:15:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 174/516] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "531edd6a-d4a2-4d1a-a02d-e5efa760b394"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f4ac726b-9912-4b5f-b751-3ca0a0621e09"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f4ac726b-9912-4b5f-b751-3ca0a0621e09"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "e3b64855-b03b-4ee1-8c89-6e3abc178faa"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "e3b64855-b03b-4ee1-8c89-6e3abc178faa"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Creating event network-vif-plugged:531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Creating event network-vif-plugged:f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Creating event network-vif-plugged:f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Creating event network-vif-plugged:e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Creating event network-vif-plugged:e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.038594 Nov 14 02:15:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 175/517] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:15 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "4c7870e4-5a12-40e6-a06c-e635347f66f5"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f3041f35-502b-4bb9-9e73-13fe8aa11484"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f3041f35-502b-4bb9-9e73-13fe8aa11484"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Creating event network-vif-plugged:4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Creating event network-vif-plugged:f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Creating event network-vif-plugged:f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040770 Nov 14 02:15:15 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 169/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:16 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f13dd1ab-e475-40ad-a7d9-18d96362a10d"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "e2acc9ad-f868-4e07-83c4-b87a1f08e670"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "e2acc9ad-f868-4e07-83c4-b87a1f08e670"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Creating event network-vif-plugged:f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Creating event network-vif-plugged:e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Creating event network-vif-plugged:e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:15:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032823 Nov 14 02:15:16 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 175/519] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:16 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:15:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f", "name": "network-vif-plugged", "status": "completed", "tag": "03336681-82cb-4a6f-b9a2-f429ade55494"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=51 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Creating event network-vif-plugged:03336681-82cb-4a6f-b9a2-f429ade55494 for instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f on user Nov 14 02:15:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067377 Nov 14 02:15:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 176/520] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:22 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:22 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f", "name": "network-vif-plugged", "status": "completed", "tag": "03336681-82cb-4a6f-b9a2-f429ade55494"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Creating event network-vif-plugged:03336681-82cb-4a6f-b9a2-f429ade55494 for instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f on user Nov 14 02:15:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 Nov 14 02:15:22 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 170/521] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] HTTP exception thrown: Instance 2f9df98c-7814-419d-8821-d8c571972f0e could not be found. Nov 14 02:15:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Returning 404 to user: Instance 2f9df98c-7814-419d-8821-d8c571972f0e could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:15:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-09a77bfd-21f6-488b-9379-645d693efcb8 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e" status: 404 len: 111 microversion: 2.1 time: 0.028656 Nov 14 02:15:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 176/522] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:26 2023] GET /compute/v2.1/servers/2f9df98c-7814-419d-8821-d8c571972f0e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-39435fa1-f721-40ce-ac3a-31e12ace8299 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048898 Nov 14 02:15:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 177/523] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:15:27 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:27 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:15:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 204 len: 0 microversion: 2.1 time: 0.129884 Nov 14 02:15:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 171/524] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:15:27 2023] DELETE /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-unplugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:27 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-f293c9ca-50b3-4708-9309-d0bcbfbf55be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 200 len: 1685 microversion: 2.1 time: 0.317723 Nov 14 02:15:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Creating event network-vif-unplugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:15:27 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 177/525] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:27 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 1685 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:15:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039612 Nov 14 02:15:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 178/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-24350cc9-2d85-427a-a2c1-34b3d9e9503f req-5dd67d46-0f7e-497a-a300-52a474608001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-deleted", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-24350cc9-2d85-427a-a2c1-34b3d9e9503f req-5dd67d46-0f7e-497a-a300-52a474608001 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-24350cc9-2d85-427a-a2c1-34b3d9e9503f req-5dd67d46-0f7e-497a-a300-52a474608001 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-24350cc9-2d85-427a-a2c1-34b3d9e9503f req-5dd67d46-0f7e-497a-a300-52a474608001 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-24350cc9-2d85-427a-a2c1-34b3d9e9503f req-5dd67d46-0f7e-497a-a300-52a474608001 service nova] Creating event network-vif-deleted:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:15:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-24350cc9-2d85-427a-a2c1-34b3d9e9503f req-5dd67d46-0f7e-497a-a300-52a474608001 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065789 Nov 14 02:15:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 172/527] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:30 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146", "name": "network-vif-plugged", "status": "completed", "tag": "6e7908eb-09c1-4662-b587-2a28838e6ca6"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:30 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Creating event network-vif-plugged:6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 on user Nov 14 02:15:30 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034697 Nov 14 02:15:30 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 178/528] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-984114335"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:33 user devstack@n-api.service[64867]: INFO nova.network.security_group_api [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Removing security group a6ca7ab3-1ead-4b19-9aec-bf1fc6df62ee from port de607b68-f250-49c9-ac97-489a341f5963 Nov 14 02:15:33 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-edaf9031-1a91-4b47-a000-fb707ce9ad91 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/action" status: 202 len: 0 microversion: 2.1 time: 0.616560 Nov 14 02:15:33 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 179/529] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:15:33 2023] POST /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:15:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Creating event network-changed:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:15:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033798 Nov 14 02:15:33 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 173/530] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:34 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'services' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:15:34 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments/8ae6554c-749e-436f-b233-36c7d3784082" status: 202 len: 0 microversion: 2.1 time: 0.199376 Nov 14 02:15:34 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 179/531] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:15:34 2023] DELETE /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments/8ae6554c-749e-436f-b233-36c7d3784082 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-1ddbedf2-56e9-4ed8-aac0-6055faebf425 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045818 Nov 14 02:15:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 180/532] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:15:34 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Creating event network-changed:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:15:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028207 Nov 14 02:15:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 174/533] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:40 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:40 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:40 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a17c4e68-f37a-405c-b301-f1e64cc58598 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 200 len: 2821 microversion: 2.32 time: 0.830515 Nov 14 02:15:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 180/534] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:15:39 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 2821 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:42 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f424adf5-1d78-4a14-b126-2a494e58e888 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1659 microversion: 2.1 time: 0.499668 Nov 14 02:15:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 181/535] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:42 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1659 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:42 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:42 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f15b77df-8435-4e37-b1fe-6536005de770 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1659 microversion: 2.1 time: 0.273745 Nov 14 02:15:42 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 175/536] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:42 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1659 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c2ed4cad-2d9e-4791-b681-183f2bc6122c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062223 Nov 14 02:15:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 181/537] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:15:45 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:45 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:15:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 204 len: 0 microversion: 2.1 time: 0.118280 Nov 14 02:15:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 182/538] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:15:45 2023] DELETE /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:45 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-69a2390f-3ca8-4aef-9ccf-5a3974d76568 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 200 len: 1658 microversion: 2.1 time: 0.409077 Nov 14 02:15:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 176/539] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:45 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 1658 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:15:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-e32bde34-88c0-4635-bb88-4aa9d0da1409 req-aad5e51c-e3cb-4e0a-8944-e5b685d05005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a9d20f-e79b-4716-abf8-a15330742167", "name": "network-vif-deleted", "tag": "cc019053-7c21-4e5c-981e-389fe4a4beed"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e32bde34-88c0-4635-bb88-4aa9d0da1409 req-aad5e51c-e3cb-4e0a-8944-e5b685d05005 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e32bde34-88c0-4635-bb88-4aa9d0da1409 req-aad5e51c-e3cb-4e0a-8944-e5b685d05005 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e32bde34-88c0-4635-bb88-4aa9d0da1409 req-aad5e51c-e3cb-4e0a-8944-e5b685d05005 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-e32bde34-88c0-4635-bb88-4aa9d0da1409 req-aad5e51c-e3cb-4e0a-8944-e5b685d05005 service nova] Creating event network-vif-deleted:cc019053-7c21-4e5c-981e-389fe4a4beed for instance 71a9d20f-e79b-4716-abf8-a15330742167 on user Nov 14 02:15:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-e32bde34-88c0-4635-bb88-4aa9d0da1409 req-aad5e51c-e3cb-4e0a-8944-e5b685d05005 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030781 Nov 14 02:15:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 182/540] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-580478083", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "b1575ac8-6126-46b4-9240-a390b02b1e47"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:47 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] validate_networks() for [('b1575ac8-6126-46b4-9240-a390b02b1e47', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Getting quotas for project cba8690ce4d3409194d26c988e0c4c51. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Getting quotas for user 2bcdcb5c382f4e98bcfeb519efe7256b and project cba8690ce4d3409194d26c988e0c4c51. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:15:48 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:15:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.785857 Nov 14 02:15:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 183/541] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:15:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:15:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1ec5b2db-35b6-48c0-b22b-a63f7dcc22e3 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:48 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1ec5b2db-35b6-48c0-b22b-a63f7dcc22e3 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:48 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-1ec5b2db-35b6-48c0-b22b-a63f7dcc22e3 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdcb5c382f4e98bcfeb519efe7256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba8690ce4d3409194d26c988e0c4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1ec5b2db-35b6-48c0-b22b-a63f7dcc22e3 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512" status: 200 len: 1205 microversion: 2.1 time: 0.065658 Nov 14 02:15:48 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 177/542] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:48 2023] GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512 => generated 1205 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:15:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc3f756-22cd-49c9-bd6e-643c69474512", "tag": "3dd03a0a-a809-4e30-ac46-c9beb40caa25"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:50 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Creating event network-changed:3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance 4dc3f756-22cd-49c9-bd6e-643c69474512 on user Nov 14 02:15:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035659 Nov 14 02:15:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 183/543] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:53 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3f756-22cd-49c9-bd6e-643c69474512", "name": "network-vif-plugged", "status": "completed", "tag": "3dd03a0a-a809-4e30-ac46-c9beb40caa25"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Creating event network-vif-plugged:3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance 4dc3f756-22cd-49c9-bd6e-643c69474512 on user Nov 14 02:15:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029486 Nov 14 02:15:53 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 184/544] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3f756-22cd-49c9-bd6e-643c69474512", "name": "network-vif-plugged", "status": "completed", "tag": "3dd03a0a-a809-4e30-ac46-c9beb40caa25"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Creating event network-vif-plugged:3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance 4dc3f756-22cd-49c9-bd6e-643c69474512 on user Nov 14 02:15:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037294 Nov 14 02:15:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 178/545] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:15:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:56 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:15:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d64600f1-baa9-4706-a1fb-1517a87574c2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 200 len: 1377 microversion: 2.1 time: 0.566272 Nov 14 02:15:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 184/546] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:15:56 2023] GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 1377 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:58 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f697c0fa-3eb4-40ef-a805-7d196e613825 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074202 Nov 14 02:15:58 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 185/547] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:15:58 2023] GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-743354389"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:15:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/action" status: 202 len: 0 microversion: 2.1 time: 0.872397 Nov 14 02:16:00 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 179/548] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:15:59 2023] POST /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/action => generated 0 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "fc3a88bd-8950-489a-aefa-a7d1fe78e7b1"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:05 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'flavor' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:16:05 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7/action" status: 200 len: 29 microversion: 2.87 time: 0.630345 Nov 14 02:16:05 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 185/549] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:16:05 2023] POST /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7/action => generated 29 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:06 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:06 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:06 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:06 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-d192a888-6ed7-467e-81ba-78a78f3a2d73 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 200 len: 1774 microversion: 2.87 time: 0.217471 Nov 14 02:16:06 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 186/550] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:16:05 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 1774 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:16:06 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-unplugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Creating event network-vif-unplugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:16:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034671 Nov 14 02:16:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 180/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-707905753", "imageRef": "083a0fe3-040d-45de-871d-f50781bb7cab", "flavorRef": "1", "key_name": "tempest-TestStampPattern-863039138", "security_groups": [{"name": "tempest-secgroup-smoke-324289811"}], "networks": [{"uuid": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] validate_networks() for [('3cb79e37-ec0c-4195-8ad1-f968e55a48dd', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting quotas for project fbfae642569847a2a3ac4cd4066aeb22. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting quotas for user 089b000c028b46b998f2c128a6cf3d0a and project fbfae642569847a2a3ac4cd4066aeb22. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:16:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='083a0fe3-040d-45de-871d-f50781bb7cab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:16:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.966319 Nov 14 02:16:08 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 186/552] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:16:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:16:08 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-0a51deab-d1d9-428d-b6ff-430a78b10481 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:08 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0a51deab-d1d9-428d-b6ff-430a78b10481 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:08 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-0a51deab-d1d9-428d-b6ff-430a78b10481 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-0a51deab-d1d9-428d-b6ff-430a78b10481 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c" status: 200 len: 1233 microversion: 2.1 time: 0.079679 Nov 14 02:16:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 187/553] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:08 2023] GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c => generated 1233 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:16:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049818 Nov 14 02:16:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 181/554] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:10 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-72cb92f1-19ed-4401-aa2c-471137577d19 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 200 len: 1502 microversion: 2.1 time: 0.202979 Nov 14 02:16:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 187/555] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:10 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:16:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046218 Nov 14 02:16:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 188/556] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Creating event network-changed:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:16:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027808 Nov 14 02:16:11 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 182/557] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:16:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027823 Nov 14 02:16:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 188/558] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:14 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "name": "network-vif-plugged", "status": "completed", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}, {"server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "name": "network-vif-plugged", "status": "completed", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Creating event network-vif-plugged:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:16:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Creating event network-vif-plugged:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:16:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034228 Nov 14 02:16:14 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 189/559] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:17 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HTTP exception thrown: Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 could not be found. Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Returning 404 to user: Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:16:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bf2f3dbd-d3ad-485e-991a-410cc6c641ef tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" status: 404 len: 111 microversion: 2.1 time: 0.031371 Nov 14 02:16:18 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 183/560] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:17 2023] GET /compute/v2.1/servers/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:16:18 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:18 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c5d6b76e-3e2f-49c2-a6d4-b4ddb547e668 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '.version_select at 0x7fc9eb137370>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c5d6b76e-3e2f-49c2-a6d4-b4ddb547e668 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808543668" status: 202 len: 0 microversion: 2.1 time: 0.026881 Nov 14 02:16:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 189/561] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:16:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808543668 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:18 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c2544626-1448-45c1-a881-be0ff31823f3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1659 microversion: 2.1 time: 0.218007 Nov 14 02:16:18 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 190/562] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:18 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1659 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-26911d42-f1a0-4148-b4da-62666608ade1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1659 microversion: 2.1 time: 0.147886 Nov 14 02:16:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 184/563] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:18 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1659 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-822a28de-9864-449a-be47-bbe100d57785 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1659 microversion: 2.1 time: 0.428113 Nov 14 02:16:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 190/564] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:19 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1659 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:24 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-bd7224bd-bab3-4b7b-8d71-81c35b3a4413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068505 Nov 14 02:16:24 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 191/565] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:16:24 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:24 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] HTTP exception thrown: Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b is not attached to volume 8ae6554c-749e-436f-b233-36c7d3784082 Nov 14 02:16:24 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Returning 404 to user: Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b is not attached to volume 8ae6554c-749e-436f-b233-36c7d3784082 {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:16:24 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a55b0d8f-729e-4ad3-9259-bdcd164a12e0 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments/8ae6554c-749e-436f-b233-36c7d3784082" status: 404 len: 154 microversion: 2.1 time: 0.089475 Nov 14 02:16:24 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 185/566] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:16:24 2023] DELETE /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/os-volume_attachments/8ae6554c-749e-436f-b233-36c7d3784082 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:27 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:16:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 204 len: 0 microversion: 2.1 time: 0.112819 Nov 14 02:16:27 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 191/567] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:16:27 2023] DELETE /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:27 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-unplugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2b19d743-cc7b-4362-abf1-b5d97bd0d637 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 200 len: 1541 microversion: 2.1 time: 0.336031 Nov 14 02:16:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 192/568] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:27 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 1541 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Creating event network-vif-unplugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:16:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120368 Nov 14 02:16:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 186/569] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-45161529-dd6f-4799-a420-21f913505fad req-ba62cc1b-ed10-43b5-9f4c-e9fac929f614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-deleted", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-45161529-dd6f-4799-a420-21f913505fad req-ba62cc1b-ed10-43b5-9f4c-e9fac929f614 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-45161529-dd6f-4799-a420-21f913505fad req-ba62cc1b-ed10-43b5-9f4c-e9fac929f614 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-45161529-dd6f-4799-a420-21f913505fad req-ba62cc1b-ed10-43b5-9f4c-e9fac929f614 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-45161529-dd6f-4799-a420-21f913505fad req-ba62cc1b-ed10-43b5-9f4c-e9fac929f614 service nova] Creating event network-vif-deleted:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:16:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-45161529-dd6f-4799-a420-21f913505fad req-ba62cc1b-ed10-43b5-9f4c-e9fac929f614 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099371 Nov 14 02:16:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 192/570] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:29 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751bcd6-e958-4216-89f9-5e23f8b9dd9b", "name": "network-vif-plugged", "status": "completed", "tag": "de607b68-f250-49c9-ac97-489a341f5963"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Creating event network-vif-plugged:de607b68-f250-49c9-ac97-489a341f5963 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b on user Nov 14 02:16:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029492 Nov 14 02:16:29 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 193/571] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HTTP exception thrown: Instance 71a9d20f-e79b-4716-abf8-a15330742167 could not be found. Nov 14 02:16:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Returning 404 to user: Instance 71a9d20f-e79b-4716-abf8-a15330742167 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:16:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c2f0c8b8-5188-408d-a2c6-f26f6cec9d34 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 404 len: 111 microversion: 2.1 time: 0.032640 Nov 14 02:16:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 187/572] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:35 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:16:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a1b21195-f5f8-4444-adfa-4dff0a4f031a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '.version_select at 0x7fc9eb135750>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a1b21195-f5f8-4444-adfa-4dff0a4f031a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-94073184" status: 202 len: 0 microversion: 2.1 time: 0.023344 Nov 14 02:16:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 193/573] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 14 02:16:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-94073184 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:16:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-99e27c9d-70c2-4238-902f-5b438c95ade6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb3776d0>, body: {"keypair": {"name": "tempest-keypair-2103484389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hcSFq1FeMc+GFWewz+4DRO7u7cjYp28OdGpahF+Hv7z4eE0Gq7BOF5NGS5EG3kUCI/UqJLtdXnEI+nJsZqRsbH4dAS6d/Sj3fx3XI2oXIUZ5Y1xduDxKEsMyUiNoEIw=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:36 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-99e27c9d-70c2-4238-902f-5b438c95ade6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:16:36 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-99e27c9d-70c2-4238-902f-5b438c95ade6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for user 4002c20dcbc94a8ea540419f20f8621e and project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:16:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-99e27c9d-70c2-4238-902f-5b438c95ade6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046503 Nov 14 02:16:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 194/574] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:16:36 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1593989199", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "2e565fc0-c932-4f99-84ef-b157a352b43c"}], "security_groups": [{"name": "tempest-securitygroup--2037102018"}], "key_name": "tempest-keypair-2103484389", "user_data": "}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] validate_networks() for [('2e565fc0-c932-4f99-84ef-b157a352b43c', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting quotas for user 4002c20dcbc94a8ea540419f20f8621e and project 246dd4dc2106412bb0ca5e71670d9557. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:16:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:16:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.552395 Nov 14 02:16:38 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 188/575] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:16:37 2023] POST /compute/v2.1/servers => generated 400 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:16:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-93dfaecb-ccec-4a36-83c8-c528a953fd7f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:38 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-93dfaecb-ccec-4a36-83c8-c528a953fd7f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:38 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-93dfaecb-ccec-4a36-83c8-c528a953fd7f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-93dfaecb-ccec-4a36-83c8-c528a953fd7f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285" status: 200 len: 1230 microversion: 2.1 time: 0.071987 Nov 14 02:16:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 194/576] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:38 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285 => generated 1230 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:38 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdcb5c382f4e98bcfeb519efe7256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba8690ce4d3409194d26c988e0c4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-133010fe-8cb0-458d-8363-13d0df80d6e0 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512" status: 200 len: 1484 microversion: 2.1 time: 0.301969 Nov 14 02:16:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 195/577] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:38 2023] GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512 => generated 1484 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:40 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Creating event network-changed:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:16:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031128 Nov 14 02:16:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 195/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-2703cb65-2405-43e6-abdf-929a3507b8a7 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.814867 Nov 14 02:16:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 189/579] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:16:40 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/os-interface => generated 1828 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:16:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "tag": "531edd6a-d4a2-4d1a-a02d-e5efa760b394"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Creating event network-changed:531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034673 Nov 14 02:16:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 196/580] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:42 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ca0f76c6-b0f5-450a-9520-129a843f09f4 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 200 len: 2821 microversion: 2.32 time: 0.430125 Nov 14 02:16:42 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 196/581] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:16:42 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 2821 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:42 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-8efa9a5b-f886-4cd1-a6d8-51d3cf27dc62 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.130674 Nov 14 02:16:42 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 190/582] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:16:42 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/os-interface => generated 1828 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:16:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-plugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Creating event network-vif-plugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:16:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037156 Nov 14 02:16:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 197/583] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-4679db2d-bae3-46d5-947b-1c05ce8d197b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1659 microversion: 2.1 time: 0.201296 Nov 14 02:16:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 197/584] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:44 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1659 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4786ccd-1c45-41bb-ae1d-76c3e036a112"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 204 len: 0 microversion: 2.32 time: 0.122447 Nov 14 02:16:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 191/585] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:16:44 2023] DELETE /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303443 Nov 14 02:16:44 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 198/586] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:16:44 2023] POST /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:44 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c59f4642-8703-4bb3-abdf-4a2401002735 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 200 len: 2946 microversion: 2.32 time: 0.323200 Nov 14 02:16:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 198/587] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:16:44 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 2946 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-unplugged", "status": "completed", "tag": "531edd6a-d4a2-4d1a-a02d-e5efa760b394"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Creating event network-vif-unplugged:531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038710 Nov 14 02:16:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 192/588] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-plugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-unplugged", "status": "completed", "tag": "4c7870e4-5a12-40e6-a06c-e635347f66f5"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "4c7870e4-5a12-40e6-a06c-e635347f66f5"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-unplugged", "status": "completed", "tag": "f3041f35-502b-4bb9-9e73-13fe8aa11484"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Creating event network-vif-plugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:16:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Creating event network-vif-unplugged:4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Creating event network-vif-plugged:4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Creating event network-vif-unplugged:f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.068830 Nov 14 02:16:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 199/589] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:45 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-unplugged", "status": "completed", "tag": "f13dd1ab-e475-40ad-a7d9-18d96362a10d"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Creating event network-vif-unplugged:f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037603 Nov 14 02:16:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 199/590] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "531edd6a-d4a2-4d1a-a02d-e5efa760b394"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-unplugged", "status": "completed", "tag": "f4ac726b-9912-4b5f-b751-3ca0a0621e09"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f4ac726b-9912-4b5f-b751-3ca0a0621e09"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-unplugged", "status": "completed", "tag": "e3b64855-b03b-4ee1-8c89-6e3abc178faa"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "e3b64855-b03b-4ee1-8c89-6e3abc178faa"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Creating event network-vif-plugged:531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Creating event network-vif-unplugged:f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Creating event network-vif-plugged:f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Creating event network-vif-unplugged:e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Creating event network-vif-plugged:e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.035116 Nov 14 02:16:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 193/591] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:46 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f3041f35-502b-4bb9-9e73-13fe8aa11484"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:47 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Creating event network-vif-plugged:f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Nov 14 02:16:47 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 200/592] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "f13dd1ab-e475-40ad-a7d9-18d96362a10d"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-unplugged", "status": "completed", "tag": "e2acc9ad-f868-4e07-83c4-b87a1f08e670"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-plugged", "status": "completed", "tag": "e2acc9ad-f868-4e07-83c4-b87a1f08e670"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Creating event network-vif-plugged:f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Creating event network-vif-unplugged:e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Creating event network-vif-plugged:e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032574 Nov 14 02:16:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 200/593] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:49 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:49 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-deleted", "tag": "f13dd1ab-e475-40ad-a7d9-18d96362a10d"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] Creating event network-vif-deleted:f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037160 Nov 14 02:16:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 194/594] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-deleted", "tag": "e3b64855-b03b-4ee1-8c89-6e3abc178faa"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-deleted", "tag": "f3041f35-502b-4bb9-9e73-13fe8aa11484"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-deleted", "tag": "e2acc9ad-f868-4e07-83c4-b87a1f08e670"}, {"server_uuid": "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88", "name": "network-vif-deleted", "tag": "531edd6a-d4a2-4d1a-a02d-e5efa760b394"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Creating event network-vif-deleted:e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Creating event network-vif-deleted:f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Creating event network-vif-deleted:e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] Creating event network-vif-deleted:531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 on user Nov 14 02:16:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031008 Nov 14 02:16:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 201/595] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:51 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Old instance type m1.tiny, new instance type m1.small {{(pid=64868) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting quotas for project 5dcd87f632574f81813bc7606a8fe70e. Resources: {'ram', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting quotas for user b73fe859f2604a1bbf70f01587cf015c and project 5dcd87f632574f81813bc7606a8fe70e. Resources: {'ram', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:16:52 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:16:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/action" status: 202 len: 0 microversion: 2.1 time: 0.468273 Nov 14 02:16:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 201/596] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:16:52 2023] POST /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:53 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-620b0463-e1d0-4175-a327-f1341207af3d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1714 microversion: 2.1 time: 0.232419 Nov 14 02:16:53 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 195/597] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:52 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1714 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-unplugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Creating event network-vif-unplugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:16:55 user devstack@n-api.service[64867]: DEBUG nova.compute.api [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64867) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:16:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044342 Nov 14 02:16:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 202/598] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:56 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-78630848-58f8-483c-8234-e001efa34dc0 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 200 len: 1754 microversion: 2.87 time: 0.324418 Nov 14 02:16:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 202/599] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:16:56 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 1754 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:56 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:56 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-da84c5cc-414d-4628-9e53-5c9c3d83820f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 200 len: 1377 microversion: 2.1 time: 0.187433 Nov 14 02:16:56 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 196/600] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:56 2023] GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 1377 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-43a2b6e7-2249-4b90-85c2-480f884057f8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 200 len: 1377 microversion: 2.1 time: 0.153344 Nov 14 02:16:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 203/601] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:56 2023] GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 1377 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:16:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 204 len: 0 microversion: 2.1 time: 0.105415 Nov 14 02:16:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 203/602] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:16:57 2023] DELETE /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-96a9dc04-8c92-4394-a2f6-1d09df7b86c8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 200 len: 1383 microversion: 2.1 time: 0.199297 Nov 14 02:16:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 197/603] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:57 2023] GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 1383 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f", "name": "network-vif-unplugged", "status": "completed", "tag": "03336681-82cb-4a6f-b9a2-f429ade55494"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Creating event network-vif-unplugged:03336681-82cb-4a6f-b9a2-f429ade55494 for instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f on user Nov 14 02:16:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051719 Nov 14 02:16:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 204/604] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:16:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:16:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071116 Nov 14 02:16:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 204/605] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:58 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:16:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a84cbb9d-9960-4da5-920c-f584c4d8fd5d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c" status: 200 len: 1534 microversion: 2.1 time: 0.307656 Nov 14 02:16:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 198/606] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:16:58 2023] GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c => generated 1534 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:16:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f", "name": "network-vif-deleted", "tag": "03336681-82cb-4a6f-b9a2-f429ade55494"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:59 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f", "name": "network-vif-plugged", "status": "completed", "tag": "03336681-82cb-4a6f-b9a2-f429ade55494"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:16:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:16:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:16:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:16:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Creating event network-vif-plugged:03336681-82cb-4a6f-b9a2-f429ade55494 for instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f on user Nov 14 02:16:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] Creating event network-vif-deleted:03336681-82cb-4a6f-b9a2-f429ade55494 for instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f on user Nov 14 02:16:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029684 Nov 14 02:16:59 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 205/607] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:16:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042606 Nov 14 02:16:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 205/608] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:17:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64866) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:17:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052618 Nov 14 02:17:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 199/609] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:09 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:09 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:09 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:17:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:17:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050584 Nov 14 02:17:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 206/610] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:11 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:17:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/action" status: 200 len: 32 microversion: 2.1 time: 0.138928 Nov 14 02:17:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 206/611] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:17:11 2023] POST /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/action => generated 32 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:12 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a1f6c806-2757-4d66-92a7-e3c02bd2da18 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 200 len: 1508 microversion: 2.1 time: 0.209951 Nov 14 02:17:12 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 200/612] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:11 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:17:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-unplugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Creating event network-vif-unplugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:17:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032571 Nov 14 02:17:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 207/613] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:14 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:17:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037410 Nov 14 02:17:14 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 207/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:16 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}, {"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:16 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:17:16 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:17:16 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029981 Nov 14 02:17:16 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 201/615] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] HTTP exception thrown: Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b could not be found. Nov 14 02:17:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Returning 404 to user: Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:17:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9d309f25-d8f2-445d-9ca2-be663b7b0f44 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b" status: 404 len: 111 microversion: 2.1 time: 0.132143 Nov 14 02:17:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 208/616] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:17 2023] GET /compute/v2.1/servers/2751bcd6-e958-4216-89f9-5e23f8b9dd9b => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:17:17 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8094acc3-c712-435a-8b35-5bdd6c6b6453 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '.version_select at 0x7fc9eb1ed360>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8094acc3-c712-435a-8b35-5bdd6c6b6453 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1349261540" status: 202 len: 0 microversion: 2.1 time: 0.027129 Nov 14 02:17:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 208/617] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Nov 14 02:17:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1349261540 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:17:20 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cf39ddbd-372a-4f58-a9cd-da8b4f8b84f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb480280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1262712773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Qai4/c8jmrXF+7sKrGwGzLpkwduY4d7UGfz12nhhhboF8T7Ehv+HP+Y/q9Ste7wY5aWF97tpO6Jn7SyB48wCDuYBRmb0sUQHOXHaWm+kkFbHfcXXqC4LxndEphuYhLw=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:20 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-cf39ddbd-372a-4f58-a9cd-da8b4f8b84f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for project 9cfe231fae1941f4970c17e344df8b81. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:17:20 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-cf39ddbd-372a-4f58-a9cd-da8b4f8b84f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for user 87f69eeadbaf45bfa01dfdfa5efcccb3 and project 9cfe231fae1941f4970c17e344df8b81. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:17:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-cf39ddbd-372a-4f58-a9cd-da8b4f8b84f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047087 Nov 14 02:17:20 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 202/618] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:17:20 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:20 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-417851207", "imageRef": "948f42ca-5bd2-49c0-b496-c1902fa97d96", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-1262712773", "networks": [{"uuid": "48fae5b7-e614-4e23-9424-98dec9f9eab6"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:20 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] validate_networks() for [('48fae5b7-e614-4e23-9424-98dec9f9eab6', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:17:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:17:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:17:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:17:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:17:20 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for project 9cfe231fae1941f4970c17e344df8b81. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting quotas for user 87f69eeadbaf45bfa01dfdfa5efcccb3 and project 9cfe231fae1941f4970c17e344df8b81. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:17:21 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='948f42ca-5bd2-49c0-b496-c1902fa97d96',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:17:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.787001 Nov 14 02:17:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 209/619] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:17:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:17:21 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-d1253bcf-e00e-425b-a468-664f330588e4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:21 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-d1253bcf-e00e-425b-a468-664f330588e4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:21 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-d1253bcf-e00e-425b-a468-664f330588e4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-d1253bcf-e00e-425b-a468-664f330588e4 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1250 microversion: 2.1 time: 0.107393 Nov 14 02:17:21 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 209/620] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:21 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1250 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:17:22 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-1977700667", "imageRef": "", "flavorRef": "1", "networks": [{"uuid": "dc8c6c51-2843-43f4-95cf-8e873f067676"}], "security_groups": [{"name": "tempest-securitygroup--246424804"}], "key_name": "tempest-keypair-1627475945", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "bfe732f2-6802-4277-9e26-6ee51b70df83", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:22 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] validate_networks() for [('dc8c6c51-2843-43f4-95cf-8e873f067676', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for user 7ffa5574e531479993ef301510f1d9e3 and project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:17:23 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfe732f2-6802-4277-9e26-6ee51b70df83',volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:17:23 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.003470 Nov 14 02:17:23 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 203/621] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:17:22 2023] POST /compute/v2.1/servers => generated 403 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:17:23 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f057334a-39b0-4bdf-9059-09393b74a6be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:23 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-f057334a-39b0-4bdf-9059-09393b74a6be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:23 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-f057334a-39b0-4bdf-9059-09393b74a6be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:23 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-f057334a-39b0-4bdf-9059-09393b74a6be tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1076 microversion: 2.1 time: 0.066025 Nov 14 02:17:23 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 210/622] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:23 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1076 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:17:24 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:24 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Creating event network-changed:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:17:24 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027508 Nov 14 02:17:24 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 210/623] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:17:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048502 Nov 14 02:17:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 204/624] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Creating event network-changed:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:17:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041748 Nov 14 02:17:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 211/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:17:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028097 Nov 14 02:17:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 211/626] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:28 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-799ee640-3bfd-4702-a33b-2ecafdfb870e tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285" status: 200 len: 1536 microversion: 2.1 time: 0.252276 Nov 14 02:17:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 205/627] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:28 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285 => generated 1536 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:17:32 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:32 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-plugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Creating event network-vif-plugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:17:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Nov 14 02:17:32 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 212/628] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:34 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=10 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] HTTP exception thrown: Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 could not be found. Nov 14 02:17:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Returning 404 to user: Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:17:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-94aed053-09cb-4f6f-8535-48b993a93959 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 404 len: 111 microversion: 2.32 time: 0.031968 Nov 14 02:17:34 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 206/629] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:17:34 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:17:34 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=8 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:34 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-cd829b9a-351a-4033-a8a9-b74e1da378ed tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '.version_select at 0x7fc9eb3fbeb0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-cd829b9a-351a-4033-a8a9-b74e1da378ed tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215674162" status: 204 len: 0 microversion: 2.32 time: 0.021953 Nov 14 02:17:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 213/630] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 14 02:17:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215674162 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:17:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-plugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Creating event network-vif-plugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:17:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108472 Nov 14 02:17:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 212/631] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] HTTP exception thrown: Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 could not be found. Nov 14 02:17:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Returning 404 to user: Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:17:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-3773897f-3638-4c31-9011-65c957eae095 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 404 len: 111 microversion: 2.32 time: 0.033223 Nov 14 02:17:38 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 207/632] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:17:38 2023] DELETE /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] HTTP exception thrown: Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 could not be found. Nov 14 02:17:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Returning 404 to user: Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:17:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c91e9075-7962-4139-ac68-f3ca1d385a46 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" status: 404 len: 111 microversion: 2.32 time: 0.033367 Nov 14 02:17:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 214/633] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:17:38 2023] GET /compute/v2.1/servers/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e25a3efd-3294-4a1a-a4b2-93412cee3000 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1713 microversion: 2.1 time: 0.308259 Nov 14 02:17:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 213/634] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:43 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1713 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:17:43 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:17:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512" status: 204 len: 0 microversion: 2.1 time: 0.139370 Nov 14 02:17:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 208/635] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:17:43 2023] DELETE /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3f756-22cd-49c9-bd6e-643c69474512", "name": "network-vif-unplugged", "status": "completed", "tag": "3dd03a0a-a809-4e30-ac46-c9beb40caa25"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:43 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdcb5c382f4e98bcfeb519efe7256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba8690ce4d3409194d26c988e0c4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d80f4204-276e-4fbb-8ce1-41884b1f445d tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512" status: 200 len: 1490 microversion: 2.1 time: 0.242162 Nov 14 02:17:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 215/636] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:43 2023] GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512 => generated 1490 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:17:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Creating event network-vif-unplugged:3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance 4dc3f756-22cd-49c9-bd6e-643c69474512 on user Nov 14 02:17:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036021 Nov 14 02:17:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 214/637] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:17:45 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3f756-22cd-49c9-bd6e-643c69474512", "name": "network-vif-plugged", "status": "completed", "tag": "3dd03a0a-a809-4e30-ac46-c9beb40caa25"}, {"server_uuid": "4dc3f756-22cd-49c9-bd6e-643c69474512", "name": "network-vif-deleted", "tag": "3dd03a0a-a809-4e30-ac46-c9beb40caa25"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Creating event network-vif-plugged:3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance 4dc3f756-22cd-49c9-bd6e-643c69474512 on user Nov 14 02:17:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Creating event network-vif-deleted:3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance 4dc3f756-22cd-49c9-bd6e-643c69474512 on user Nov 14 02:17:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032772 Nov 14 02:17:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 209/638] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f could not be found. Nov 14 02:17:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:17:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-35303179-4982-4949-8496-31939b449e5b tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 404 len: 111 microversion: 2.1 time: 0.026174 Nov 14 02:17:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 216/639] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:47 2023] GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f could not be found. Nov 14 02:17:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:17:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-bbe71f8d-a8a3-4b8a-9f4b-c8fc9e418130 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 404 len: 111 microversion: 2.1 time: 0.028907 Nov 14 02:17:47 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 215/640] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:17:47 2023] DELETE /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f could not be found. Nov 14 02:17:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:17:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b29585b9-f824-44c4-98ef-702722d4d7aa tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" status: 404 len: 111 microversion: 2.1 time: 0.028209 Nov 14 02:17:47 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 210/641] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:47 2023] GET /compute/v2.1/servers/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:17:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ea2d61af-e0e0-4a12-a33e-58ef61131fcf tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb4a29e0>, body: {"keypair": {"name": "tempest-keypair-1627011863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/+9CMLVpa/whcV4Tg4EhYx30XdEKCDGSZ2vFlN/0qq0gnew7RwjUilCukmZaf3/GXHbwxxxJNSxoEdKvsjjv2zhfLMlAbt82+zEF9wGzEhk9GhqMsdkL8/VTPKHfp1WQ=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:52 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ea2d61af-e0e0-4a12-a33e-58ef61131fcf tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:17:52 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ea2d61af-e0e0-4a12-a33e-58ef61131fcf tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:17:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ea2d61af-e0e0-4a12-a33e-58ef61131fcf tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047294 Nov 14 02:17:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 217/642] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:17:52 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1353021008", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "46354624-906b-41f0-bf9d-b1a415b27359", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "82975375-7a5b-4666-9ca1-d92490943dd9"}], "security_groups": [{"name": "tempest-securitygroup--1455314985"}], "key_name": "tempest-keypair-1627011863", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] validate_networks() for [('82975375-7a5b-4666-9ca1-d92490943dd9', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:17:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46354624-906b-41f0-bf9d-b1a415b27359',volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:17:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.817379 Nov 14 02:17:54 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 216/643] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:17:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:17:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-fed21f69-02d9-4919-a818-68bea8dd8cce tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:54 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-fed21f69-02d9-4919-a818-68bea8dd8cce tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:54 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-fed21f69-02d9-4919-a818-68bea8dd8cce tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-fed21f69-02d9-4919-a818-68bea8dd8cce tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 200 len: 1088 microversion: 2.1 time: 0.068510 Nov 14 02:17:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 211/644] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:54 2023] GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7/action" status: 202 len: 0 microversion: 2.87 time: 0.126752 Nov 14 02:17:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 218/645] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:17:56 2023] POST /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:56 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:56 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-756088ab-8555-4ff2-aa18-e786ea38c07d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 200 len: 1762 microversion: 2.87 time: 0.282279 Nov 14 02:17:56 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 217/646] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:17:56 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 1762 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:17:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-unplugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:17:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Creating event network-vif-unplugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:17:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035094 Nov 14 02:17:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 212/647] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987991d7-8a45-49ee-a516-fac07e1d8589", "tag": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:17:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Creating event network-changed:3f087bec-f4a3-4cc7-85a4-bbc27914cbae for instance 987991d7-8a45-49ee-a516-fac07e1d8589 on user Nov 14 02:17:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036675 Nov 14 02:17:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 219/648] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:17:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:17:58 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:17:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-180373cd-306d-4406-86a5-b2266c7834de tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c" status: 200 len: 1534 microversion: 2.1 time: 0.328676 Nov 14 02:17:58 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 218/649] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:17:58 2023] GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c => generated 1534 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:18:00 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:18:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030532 Nov 14 02:18:00 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 213/650] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "082080ba-2293-4cc1-aad0-dacf038a663e"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361952 Nov 14 02:18:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 220/651] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:18:01 2023] POST /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:02 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}, {"name": "network-changed", "server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}, {"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:18:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Creating event network-changed:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:18:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:18:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.037571 Nov 14 02:18:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 214/652] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:02 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:02 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8be4ecd9-bc69-4a20-9279-563b3479be3b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 200 len: 1488 microversion: 2.1 time: 0.555506 Nov 14 02:18:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 219/653] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:18:02 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 1488 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:18:04 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987991d7-8a45-49ee-a516-fac07e1d8589", "name": "network-vif-plugged", "status": "completed", "tag": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Creating event network-vif-plugged:3f087bec-f4a3-4cc7-85a4-bbc27914cbae for instance 987991d7-8a45-49ee-a516-fac07e1d8589 on user Nov 14 02:18:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050533 Nov 14 02:18:04 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 221/654] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:18:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:06 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987991d7-8a45-49ee-a516-fac07e1d8589", "name": "network-vif-plugged", "status": "completed", "tag": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Creating event network-vif-plugged:3f087bec-f4a3-4cc7-85a4-bbc27914cbae for instance 987991d7-8a45-49ee-a516-fac07e1d8589 on user Nov 14 02:18:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030346 Nov 14 02:18:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 215/655] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:10 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'services' on Instance uuid 1bff6ecf-69c8-4940-8085-bb5f331ca91c {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:18:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments/082080ba-2293-4cc1-aad0-dacf038a663e" status: 202 len: 0 microversion: 2.1 time: 0.181517 Nov 14 02:18:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 220/656] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:18:10 2023] DELETE /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments/082080ba-2293-4cc1-aad0-dacf038a663e => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:10 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ad4c36a4-56eb-49be-bb2e-6f4918dbdf81 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054994 Nov 14 02:18:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 222/657] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:18:10 2023] GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:11 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-58b30d65-8a6e-47b9-bd90-15a6e88659a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1534 microversion: 2.1 time: 0.204098 Nov 14 02:18:11 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 216/658] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:18:11 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1534 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:13 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c03df854-3357-4faa-8d8a-eddf815f99b7 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1430 microversion: 2.1 time: 0.337036 Nov 14 02:18:13 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 221/659] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:18:13 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1430 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:18:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-57269275-592e-436f-b3a4-68631a9e663b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb2a4430>, body: {"keypair": {"name": "tempest-keypair-1744969399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNTz2d3GJuvS5CW6sTnUaAmT+KYp2EJmlGkb0wNZl+WWgtkFVUgYoM6HJEmYEFDMRwaBXEI+jsS3sdRXNVmHwb4u+menTy6hdNQs4uiJ1UBAoQVLynDNCjoRx4vv/+Ilg=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:19 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-57269275-592e-436f-b3a4-68631a9e663b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:18:19 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-57269275-592e-436f-b3a4-68631a9e663b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for user 0729cfec73f44f4eafb49d51f9ce01e2 and project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:18:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-57269275-592e-436f-b3a4-68631a9e663b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043017 Nov 14 02:18:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 223/660] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:18:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:20 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-438855487", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2"}], "security_groups": [{"name": "tempest-securitygroup--368018452"}], "key_name": "tempest-keypair-1744969399", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:20 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:20 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] validate_networks() for [('dfcd5f09-6f3c-4ea6-b88a-76233441a7c2', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for user 0729cfec73f44f4eafb49d51f9ce01e2 and project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:18:21 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:18:21 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.701621 Nov 14 02:18:21 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 217/661] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:18:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:18:21 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6ba92674-42b3-47c3-9887-f91f9f241838 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:21 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6ba92674-42b3-47c3-9887-f91f9f241838 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:21 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-6ba92674-42b3-47c3-9887-f91f9f241838 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6ba92674-42b3-47c3-9887-f91f9f241838 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232" status: 200 len: 1234 microversion: 2.1 time: 0.103822 Nov 14 02:18:21 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 222/662] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:18:21 2023] GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232 => generated 1234 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:18:24 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=5 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:24 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef2a690-6f55-4d15-aac7-323e90b3e232", "tag": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Creating event network-changed:0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 on user Nov 14 02:18:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033916 Nov 14 02:18:24 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 224/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef2a690-6f55-4d15-aac7-323e90b3e232", "name": "network-vif-plugged", "status": "completed", "tag": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Creating event network-vif-plugged:0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 on user Nov 14 02:18:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061208 Nov 14 02:18:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 218/664] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:18:28 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=5 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef2a690-6f55-4d15-aac7-323e90b3e232", "name": "network-vif-plugged", "status": "completed", "tag": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Creating event network-vif-plugged:0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 on user Nov 14 02:18:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 Nov 14 02:18:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 223/665] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-2bea7418-b1aa-41de-979f-b8bfd7ae1cb9 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.135081 Nov 14 02:18:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 225/666] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:18:28 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-interface => generated 282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Creating event network-changed:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:18:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033346 Nov 14 02:18:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 219/667] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ee61b32c-96b4-495e-b57f-8ffc809a3d60 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/ips" status: 200 len: 104 microversion: 2.1 time: 0.037113 Nov 14 02:18:29 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 224/668] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:18:29 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/ips => generated 104 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994660a4-71d0-4feb-a152-bef2c9825c2f"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276833 Nov 14 02:18:31 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 226/669] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:18:31 2023] POST /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] HTTP exception thrown: Instance 4dc3f756-22cd-49c9-bd6e-643c69474512 could not be found. Nov 14 02:18:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Returning 404 to user: Instance 4dc3f756-22cd-49c9-bd6e-643c69474512 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:18:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f66500e7-e941-4974-8025-202938c28152 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512" status: 404 len: 111 microversion: 2.1 time: 0.031765 Nov 14 02:18:33 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 220/670] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:18:33 2023] GET /compute/v2.1/servers/4dc3f756-22cd-49c9-bd6e-643c69474512 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:39 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:39 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-223a554e-ac67-4ed5-9e40-36f43e6f83cd tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060924 Nov 14 02:18:39 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 225/671] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:18:39 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-6ee2ce26-9789-4614-9069-56fbdf5bd7b8 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/994660a4-71d0-4feb-a152-bef2c9825c2f" status: 200 len: 194 microversion: 2.1 time: 0.042203 Nov 14 02:18:39 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 227/672] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 14 02:18:39 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/994660a4-71d0-4feb-a152-bef2c9825c2f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97417f33-08c2-4f70-ba3e-d5a6ff297411"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347848 Nov 14 02:18:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 221/673] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:18:40 2023] POST /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/action" status: 202 len: 0 microversion: 2.1 time: 0.270862 Nov 14 02:18:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 226/674] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:18:43 2023] POST /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:44 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0fd1193a-44c0-4129-98d2-7af7900fa69e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1712 microversion: 2.1 time: 0.307865 Nov 14 02:18:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 228/675] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:18:43 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1712 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:18:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-unplugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Creating event network-vif-unplugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:18:44 user devstack@n-api.service[64866]: DEBUG nova.compute.api [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64866) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:18:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045878 Nov 14 02:18:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 222/676] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:45 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-d5220ca7-66bd-4827-a768-04e4f78e7354 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 200 len: 1442 microversion: 2.1 time: 0.203721 Nov 14 02:18:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 227/677] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:18:44 2023] GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 1442 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:18:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:18:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:18:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037864 Nov 14 02:18:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 229/678] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:47 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:18:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a4f893b1-d072-4653-bd8b-2aeabd8ba1ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 200 len: 1768 microversion: 2.87 time: 0.225558 Nov 14 02:18:47 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 223/679] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:18:47 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 1768 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-0d152b0d-4455-4fe6-8ad2-30bdd376688f tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041970 Nov 14 02:18:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 228/680] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:18:48 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-5409bb61-984e-4fc2-a824-aeef366e4444 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/994660a4-71d0-4feb-a152-bef2c9825c2f" status: 200 len: 194 microversion: 2.1 time: 0.040119 Nov 14 02:18:48 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 230/681] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 14 02:18:48 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/994660a4-71d0-4feb-a152-bef2c9825c2f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:49 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'services' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:18:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/994660a4-71d0-4feb-a152-bef2c9825c2f" status: 202 len: 0 microversion: 2.1 time: 0.171555 Nov 14 02:18:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 224/682] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:18:48 2023] DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/994660a4-71d0-4feb-a152-bef2c9825c2f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:18:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:18:55 user devstack@n-api.service[64867]: DEBUG nova.compute.api [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64867) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:18:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055523 Nov 14 02:18:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 229/683] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:18:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:18:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:18:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:18:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:18:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:18:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Nov 14 02:18:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 231/684] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:18:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a00d7064-04ee-4a6a-8cc0-0ccd944e290d tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083378 Nov 14 02:19:00 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 225/685] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:19:00 2023] GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Creating event network-changed:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:19:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030919 Nov 14 02:19:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 232/686] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:19:01 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:19:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c" status: 204 len: 0 microversion: 2.1 time: 0.146804 Nov 14 02:19:01 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 230/687] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:19:01 2023] DELETE /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "name": "network-vif-unplugged", "status": "completed", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Creating event network-vif-unplugged:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:19:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e5cc1542-192a-4c19-8d92-0e7fc14b6bb6 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c" status: 200 len: 1659 microversion: 2.1 time: 0.320809 Nov 14 02:19:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 226/688] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:01 2023] GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c => generated 1659 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034478 Nov 14 02:19:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 233/689] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb5987c4-1aea-43ee-9d01-bfa946c578e7"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef while it is in vm_state rescued Nov 14 02:19:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Returning 409 to user: Cannot 'attach_volume' instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef while it is in vm_state rescued {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:19:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-95231357-776c-4fba-8b2e-e69948bd477f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074914 Nov 14 02:19:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 231/690] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:19:02 2023] POST /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/os-volume_attachments => generated 152 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/action" status: 202 len: 0 microversion: 2.1 time: 0.100908 Nov 14 02:19:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 227/691] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:19:02 2023] POST /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:03 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-8000de6a-4e0f-414b-ae42-ab36e8f059a6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 200 len: 1496 microversion: 2.1 time: 0.226700 Nov 14 02:19:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 234/692] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:02 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 1496 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "name": "network-vif-deleted", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] Creating event network-vif-deleted:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:19:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030559 Nov 14 02:19:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 232/693] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bff6ecf-69c8-4940-8085-bb5f331ca91c", "name": "network-vif-plugged", "status": "completed", "tag": "826a1529-1134-4ec2-bf5e-bc15f0af1f75"}, {"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-unplugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}, {"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Creating event network-vif-plugged:826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c on user Nov 14 02:19:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Creating event network-vif-unplugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:19:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:19:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040122 Nov 14 02:19:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 228/694] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:04 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:06 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}, {"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:19:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:19:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043114 Nov 14 02:19:06 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 235/695] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c7f32a51-21f9-402f-89cf-bae60679002b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232" status: 200 len: 1541 microversion: 2.1 time: 0.254815 Nov 14 02:19:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 233/696] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:11 2023] GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232 => generated 1541 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-34c80be2-7fa1-4089-b9f5-76f68461f672 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1534 microversion: 2.1 time: 0.205282 Nov 14 02:19:11 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 229/697] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:11 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1534 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching by: {'deleted': False, 'project_id': '9cfe231fae1941f4970c17e344df8b81'} {{(pid=64868) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-aa43dd61-e56f-4e05-8a89-c1fda0889ad5 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/97417f33-08c2-4f70-ba3e-d5a6ff297411" status: 200 len: 194 microversion: 2.1 time: 0.039443 Nov 14 02:19:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 234/698] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 14 02:19:11 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/97417f33-08c2-4f70-ba3e-d5a6ff297411 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64868]: DEBUG nova.compute.multi_cell_list [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 14 02:19:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-67ac2d02-d606-45b0-95a9-251801edbdfa tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.164121 Nov 14 02:19:11 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 236/699] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 14 02:19:11 2023] GET /compute/v2.1/servers => generated 340 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:11 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'services' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/97417f33-08c2-4f70-ba3e-d5a6ff297411" status: 202 len: 0 microversion: 2.1 time: 0.168575 Nov 14 02:19:12 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 230/700] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:19:11 2023] DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments/97417f33-08c2-4f70-ba3e-d5a6ff297411 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:19:12 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-fff6f406-6c13-49a9-badc-9bd961c5e5a5 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1534 microversion: 2.1 time: 0.159772 Nov 14 02:19:12 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 235/701] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:11 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1534 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "006829f8-9e9b-4d9a-a76a-ed873c5b57fb"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:13 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358987 Nov 14 02:19:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 237/702] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:19:13 2023] POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-83333a2c-6848-4fba-928d-3e82bb74341b tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.198695 Nov 14 02:19:14 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 231/703] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:19:14 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/os-interface => generated 282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Creating event network-changed:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:19:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029819 Nov 14 02:19:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 236/704] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bf3a15bd-0c37-4da7-ae2f-6d74fd33fd2d tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1430 microversion: 2.1 time: 0.243637 Nov 14 02:19:15 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 238/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:15 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1430 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Old instance type m1.tiny, new instance type m1.small {{(pid=64866) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting quotas for user 7ffa5574e531479993ef301510f1d9e3 and project a1ba9547629f4ea1b40424e277e17d25. Resources: {'ram', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:19:15 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:19:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/action" status: 202 len: 0 microversion: 2.1 time: 0.361312 Nov 14 02:19:15 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 232/706] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:19:15 2023] POST /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:15 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-dd3a09b6-654a-4b0e-871b-31b874f612a9 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1439 microversion: 2.1 time: 0.195748 Nov 14 02:19:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 237/707] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:15 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1439 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Creating event network-changed:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:19:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:19:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052675 Nov 14 02:19:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 239/708] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-unplugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Creating event network-vif-unplugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:19:18 user devstack@n-api.service[64866]: DEBUG nova.compute.api [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64866) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:19:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043133 Nov 14 02:19:18 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 233/709] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-plugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Creating event network-vif-plugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:19:20 user devstack@n-api.service[64867]: DEBUG nova.compute.api [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64867) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:19:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038904 Nov 14 02:19:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 238/710] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:22 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:23 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:23 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-aca0ab90-4bc8-4efb-8c4d-b497f91ced06 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1580 microversion: 2.1 time: 0.313453 Nov 14 02:19:23 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 240/711] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:22 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1580 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Creating event network-changed:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:19:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052265 Nov 14 02:19:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 234/712] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1382043427"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:27 user devstack@n-api.service[64867]: INFO nova.network.security_group_api [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Adding security group 15ab3d4c-7b60-4bf3-8a87-29c565aadc49 to port fb569262-fb03-4fa0-9d3d-80ab79690476 Nov 14 02:19:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-78f61c58-cf02-47e3-9ed2-30067839f545 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/action" status: 202 len: 0 microversion: 2.1 time: 0.695689 Nov 14 02:19:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 239/713] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:19:26 2023] POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:19:27 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Creating event network-changed:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:19:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039901 Nov 14 02:19:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 235/714] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:27 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-eba880d4-2b79-4512-9599-6375b0dae5a2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1746 microversion: 2.1 time: 0.224256 Nov 14 02:19:27 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 241/715] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:27 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/action" status: 202 len: 0 microversion: 2.1 time: 0.102474 Nov 14 02:19:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 240/716] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:19:27 2023] POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:28 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0dbd5d7d-d46b-437e-8410-67a9d926c413 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1738 microversion: 2.1 time: 0.278907 Nov 14 02:19:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 236/717] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:28 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-plugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Creating event network-vif-plugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:19:29 user devstack@n-api.service[64868]: DEBUG nova.compute.api [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:19:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036460 Nov 14 02:19:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 242/718] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:31 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-plugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}, {"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-unplugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}, {"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:31 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=110,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Creating event network-vif-plugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:19:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Creating event network-vif-unplugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:19:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:19:31 user devstack@n-api.service[64867]: DEBUG nova.compute.api [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64867) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 14 02:19:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.048514 Nov 14 02:19:31 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 241/719] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:31 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:19:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045783 Nov 14 02:19:33 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 237/720] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:34 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:34 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-2b350f6a-34b5-436c-83f6-d12cd3448994 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1705 microversion: 2.1 time: 0.242523 Nov 14 02:19:34 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 243/721] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:34 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1705 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-977950ef-6361-4335-a58c-8f88bb5bb638 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061031 Nov 14 02:19:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 242/722] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:19:34 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-4ee3674f-f4bd-48d8-832e-825efd59b50d tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128565 Nov 14 02:19:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 238/723] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:19:34 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:19:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285" status: 204 len: 0 microversion: 2.1 time: 0.131857 Nov 14 02:19:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 244/724] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:19:35 2023] DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:35 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7699bec8-cdba-4c54-ab98-88d94d24e3c6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285" status: 200 len: 1660 microversion: 2.1 time: 0.263209 Nov 14 02:19:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 243/725] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:35 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285 => generated 1660 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:19:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-unplugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060284 Nov 14 02:19:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 239/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Creating event network-vif-unplugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:19:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057767 Nov 14 02:19:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 245/727] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-deleted", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] Creating event network-vif-deleted:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:19:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Nov 14 02:19:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 244/728] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-plugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}, {"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-plugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}, {"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-plugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}, {"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-unplugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}, {"server_uuid": "8487e985-c0d1-4bbd-9c28-c3312d737285", "name": "network-vif-plugged", "status": "completed", "tag": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Creating event network-vif-plugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:19:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Creating event network-vif-plugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:19:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Creating event network-vif-plugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:19:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Creating event network-vif-unplugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:19:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Creating event network-vif-plugged:8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 on user Nov 14 02:19:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037543 Nov 14 02:19:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 240/729] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-62d68a0a-c8ed-4a74-90ea-d6aab3bd9b15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.173367 Nov 14 02:19:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 246/730] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:19:45 2023] GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589/os-interface => generated 283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:46 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987991d7-8a45-49ee-a516-fac07e1d8589", "tag": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Creating event network-changed:3f087bec-f4a3-4cc7-85a4-bbc27914cbae for instance 987991d7-8a45-49ee-a516-fac07e1d8589 on user Nov 14 02:19:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036335 Nov 14 02:19:46 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 245/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:46 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6ce210e3-c340-4045-a9a5-15ec7bbab421 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 200 len: 1442 microversion: 2.1 time: 0.332799 Nov 14 02:19:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 241/732] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:46 2023] GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 1442 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1050006547"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:46 user devstack@n-api.service[64868]: INFO nova.compute.api [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Attempting to quiesce instance before volume snapshot. Nov 14 02:19:46 user devstack@n-api.service[64868]: INFO nova.compute.api [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 14 02:19:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Creating snapshot from volume 46354624-906b-41f0-bf9d-b1a415b27359. {{(pid=64868) snapshot_instance /opt/stack/nova/nova/compute/api.py:3512}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1009716805", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "02278215-38bd-499d-a1ab-1d2bb873b0ee"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] validate_networks() for [('02278215-38bd-499d-a1ab-1d2bb873b0ee', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for user addcfdac50de4b03bd3ad3142508edea and project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:19:47 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:19:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.569938 Nov 14 02:19:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 246/733] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:19:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:19:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0bcd15c8-2618-4d2c-a6d5-c2bc9a2a46f1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:48 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-0bcd15c8-2618-4d2c-a6d5-c2bc9a2a46f1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:48 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-0bcd15c8-2618-4d2c-a6d5-c2bc9a2a46f1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:48 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-0bcd15c8-2618-4d2c-a6d5-c2bc9a2a46f1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:48 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-0bcd15c8-2618-4d2c-a6d5-c2bc9a2a46f1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0bcd15c8-2618-4d2c-a6d5-c2bc9a2a46f1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b" status: 200 len: 1395 microversion: 2.87 time: 0.076137 Nov 14 02:19:48 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 242/734] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:19:48 2023] GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b => generated 1395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:19:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-6ddc6601-7691-418f-b465-2e9c169ff345 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589/action" status: 202 len: 0 microversion: 2.1 time: 2.662133 Nov 14 02:19:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 247/735] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:19:46 2023] POST /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589/action => generated 0 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 14 02:19:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-1ccb0166-7cb1-471b-80d8-edb693569e61 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb152710>, body: {"keypair": {"name": "tempest-keypair-122805512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMfSbaIQjsDXUesX0QJMxpnjVwksnTpxHa42LE+eNaaAX/mAoIPiSgn1p7l9i13oPo6C0FpWOPz7OfXHeP0HYMXBBGYL0SUBqbQg6edWbX6TYbhkpiErBvy9B4KFFcTZQ=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:49 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-1ccb0166-7cb1-471b-80d8-edb693569e61 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:19:49 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-1ccb0166-7cb1-471b-80d8-edb693569e61 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:19:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-1ccb0166-7cb1-471b-80d8-edb693569e61 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161676 Nov 14 02:19:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 247/736] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:19:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9ecc12-fe4e-4124-8f4c-2160cd08337b", "tag": "9f182a18-791f-4fba-b4b9-787664194dd7"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Creating event network-changed:9f182a18-791f-4fba-b4b9-787664194dd7 for instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b on user Nov 14 02:19:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034454 Nov 14 02:19:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 243/737] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-655354691", "imageRef": "7ec1582b-bd06-4bd6-ad74-b5cfd1ffd97b", "flavorRef": "1", "networks": [{"uuid": "82975375-7a5b-4666-9ca1-d92490943dd9"}], "security_groups": [{"name": "tempest-securitygroup--1978395174"}], "key_name": "tempest-keypair-122805512", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] validate_networks() for [('82975375-7a5b-4666-9ca1-d92490943dd9', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:19:51 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b0c43ae3-281c-424f-94ca-013918479196',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:19:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.625681 Nov 14 02:19:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 248/738] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:19:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:19:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6f2db148-d587-4af4-9d8f-3829af6b44a3 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:52 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6f2db148-d587-4af4-9d8f-3829af6b44a3 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:52 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-6f2db148-d587-4af4-9d8f-3829af6b44a3 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6f2db148-d587-4af4-9d8f-3829af6b44a3 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 200 len: 1244 microversion: 2.1 time: 0.060634 Nov 14 02:19:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 248/739] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:52 2023] GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 1244 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] HTTP exception thrown: Instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c could not be found. Nov 14 02:19:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Returning 404 to user: Instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:19:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-893d5994-f9d0-4c37-b685-7a9f548f75c5 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c" status: 404 len: 111 microversion: 2.1 time: 0.030473 Nov 14 02:19:52 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 244/740] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:52 2023] GET /compute/v2.1/servers/1bff6ecf-69c8-4940-8085-bb5f331ca91c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:19:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9ecc12-fe4e-4124-8f4c-2160cd08337b", "name": "network-vif-plugged", "status": "completed", "tag": "9f182a18-791f-4fba-b4b9-787664194dd7"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Creating event network-vif-plugged:9f182a18-791f-4fba-b4b9-787664194dd7 for instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b on user Nov 14 02:19:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029480 Nov 14 02:19:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 249/741] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:53 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-60680375-b47f-4458-8a2b-dfc81505553e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 200 len: 1502 microversion: 2.1 time: 0.299577 Nov 14 02:19:53 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 249/742] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:53 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:19:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9ecc12-fe4e-4124-8f4c-2160cd08337b", "name": "network-vif-plugged", "status": "completed", "tag": "9f182a18-791f-4fba-b4b9-787664194dd7"}, {"name": "network-changed", "server_uuid": "055ad398-aa12-4378-a63a-e2a3562f661e", "tag": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Creating event network-vif-plugged:9f182a18-791f-4fba-b4b9-787664194dd7 for instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b on user Nov 14 02:19:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Creating event network-changed:8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance 055ad398-aa12-4378-a63a-e2a3562f661e on user Nov 14 02:19:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042596 Nov 14 02:19:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 245/743] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] HTTP exception thrown: Instance c226a1bf-4b89-49e0-ad8f-149849f12639 is not attached to volume 490a80de-6c27-4e49-b5d1-5fcbfffa3f34 Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Returning 404 to user: Instance c226a1bf-4b89-49e0-ad8f-149849f12639 is not attached to volume 490a80de-6c27-4e49-b5d1-5fcbfffa3f34 {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:19:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-370e6b0a-1688-4007-8940-ae39e718cfcb tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments/490a80de-6c27-4e49-b5d1-5fcbfffa3f34" status: 404 len: 154 microversion: 2.1 time: 0.083100 Nov 14 02:19:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 250/744] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:19:56 2023] DELETE /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639/os-volume_attachments/490a80de-6c27-4e49-b5d1-5fcbfffa3f34 => generated 154 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:56 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:56 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Creating event network-changed:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:19:56 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034943 Nov 14 02:19:56 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 246/745] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:19:56 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:19:56 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639" status: 204 len: 0 microversion: 2.1 time: 0.137265 Nov 14 02:19:56 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 250/746] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:19:56 2023] DELETE /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:56 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:57 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:19:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c3bbb5a7-69a4-4133-b009-dd4f7f1afbd2 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639" status: 200 len: 1657 microversion: 2.1 time: 0.301495 Nov 14 02:19:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 251/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:19:56 2023] GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639 => generated 1657 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:19:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-35e44daa-9b63-4192-968b-374a9a13ba9b req-97e280ae-7dc3-46e1-8376-10d2adff2666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "name": "network-vif-deleted", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-35e44daa-9b63-4192-968b-374a9a13ba9b req-97e280ae-7dc3-46e1-8376-10d2adff2666 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-35e44daa-9b63-4192-968b-374a9a13ba9b req-97e280ae-7dc3-46e1-8376-10d2adff2666 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-35e44daa-9b63-4192-968b-374a9a13ba9b req-97e280ae-7dc3-46e1-8376-10d2adff2666 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-35e44daa-9b63-4192-968b-374a9a13ba9b req-97e280ae-7dc3-46e1-8376-10d2adff2666 service nova] Creating event network-vif-deleted:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:19:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-35e44daa-9b63-4192-968b-374a9a13ba9b req-97e280ae-7dc3-46e1-8376-10d2adff2666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049812 Nov 14 02:19:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 247/748] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:19:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "name": "network-vif-unplugged", "status": "completed", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}, {"server_uuid": "c226a1bf-4b89-49e0-ad8f-149849f12639", "name": "network-vif-plugged", "status": "completed", "tag": "4f86002d-ead3-4d58-be50-4e1d2c09896a"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:19:58 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:19:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:19:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:19:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:19:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Creating event network-vif-unplugged:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:19:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Creating event network-vif-plugged:4f86002d-ead3-4d58-be50-4e1d2c09896a for instance c226a1bf-4b89-49e0-ad8f-149849f12639 on user Nov 14 02:19:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047837 Nov 14 02:19:58 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 251/749] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:06 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3d3ee2e9-8782-4162-b49c-76e80fc0e7fc tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1556 microversion: 2.1 time: 0.202603 Nov 14 02:20:06 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 252/750] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:05 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:20:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055ad398-aa12-4378-a63a-e2a3562f661e", "name": "network-vif-plugged", "status": "completed", "tag": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=63 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=106,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Creating event network-vif-plugged:8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance 055ad398-aa12-4378-a63a-e2a3562f661e on user Nov 14 02:20:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040214 Nov 14 02:20:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 248/751] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:09 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055ad398-aa12-4378-a63a-e2a3562f661e", "name": "network-vif-plugged", "status": "completed", "tag": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:09 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=12 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:09 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:09 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Creating event network-vif-plugged:8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance 055ad398-aa12-4378-a63a-e2a3562f661e on user Nov 14 02:20:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037602 Nov 14 02:20:09 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 252/752] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-506689cc-396e-46d2-b587-aa0feca30cff tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.150334 Nov 14 02:20:11 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 253/753] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:20:11 2023] GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232/os-interface => generated 282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:12 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef2a690-6f55-4d15-aac7-323e90b3e232", "tag": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Creating event network-changed:0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 on user Nov 14 02:20:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 Nov 14 02:20:12 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 249/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9bac177-b16d-4e2e-82ef-12caa90ec908", "device": "/dev/vdb"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332258 Nov 14 02:20:14 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 253/755] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:20:13 2023] POST /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:18 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-f8bb0082-aaa1-4f9f-831a-92059abce2f9 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1746 microversion: 2.1 time: 0.260669 Nov 14 02:20:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 254/756] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:18 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1746 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HTTP exception thrown: Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 could not be found. Nov 14 02:20:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Returning 404 to user: Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:20:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-cfd74010-6c57-4fa9-9b47-fc5056a0014a tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285" status: 404 len: 111 microversion: 2.1 time: 0.113450 Nov 14 02:20:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 250/757] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:25 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:20:25 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c1578687-f568-405f-81a0-586378d2c40c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '.version_select at 0x7fc9eb1524d0>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:25 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:25 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c1578687-f568-405f-81a0-586378d2c40c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103484389" status: 202 len: 0 microversion: 2.1 time: 0.036611 Nov 14 02:20:25 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 254/758] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:20:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103484389 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HTTP exception thrown: Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 could not be found. Nov 14 02:20:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Returning 404 to user: Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:20:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bfadaab3-c351-4cfa-960d-3728cd51cfb3 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285" status: 404 len: 111 microversion: 2.1 time: 0.034415 Nov 14 02:20:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 255/759] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:20:28 2023] DELETE /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HTTP exception thrown: Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 could not be found. Nov 14 02:20:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Returning 404 to user: Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:20:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d70a5361-3def-4dda-94f6-1d1847042069 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285" status: 404 len: 111 microversion: 2.1 time: 0.034164 Nov 14 02:20:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 251/760] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:28 2023] GET /compute/v2.1/servers/8487e985-c0d1-4bbd-9c28-c3312d737285 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:29 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'services' on Instance uuid 0ef2a690-6f55-4d15-aac7-323e90b3e232 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:20:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232/os-volume_attachments/c9bac177-b16d-4e2e-82ef-12caa90ec908" status: 202 len: 0 microversion: 2.1 time: 0.180342 Nov 14 02:20:29 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 255/761] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:20:29 2023] DELETE /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232/os-volume_attachments/c9bac177-b16d-4e2e-82ef-12caa90ec908 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:29 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:20:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232" status: 204 len: 0 microversion: 2.1 time: 0.117723 Nov 14 02:20:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 256/762] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:20:29 2023] DELETE /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:29 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b74275a5-72bd-4a2c-b6b2-94ac9d5925c3 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232" status: 200 len: 1712 microversion: 2.1 time: 0.288000 Nov 14 02:20:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 252/763] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:29 2023] GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232 => generated 1712 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HTTP exception thrown: Instance 71a9d20f-e79b-4716-abf8-a15330742167 could not be found. Nov 14 02:20:31 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Returning 404 to user: Instance 71a9d20f-e79b-4716-abf8-a15330742167 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:20:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b84910ff-2a79-4ba7-9573-dd9ea25fb541 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 404 len: 111 microversion: 2.1 time: 0.027408 Nov 14 02:20:31 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 256/764] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:20:31 2023] DELETE /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HTTP exception thrown: Instance 71a9d20f-e79b-4716-abf8-a15330742167 could not be found. Nov 14 02:20:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Returning 404 to user: Instance 71a9d20f-e79b-4716-abf8-a15330742167 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:20:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-53e3fdae-cc27-44c4-9471-bf7431127c62 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167" status: 404 len: 111 microversion: 2.1 time: 0.026603 Nov 14 02:20:31 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 257/765] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:31 2023] GET /compute/v2.1/servers/71a9d20f-e79b-4716-abf8-a15330742167 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:34 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d0e0f8ee-ae26-4543-9ef0-5c3dad4297ce tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1705 microversion: 2.1 time: 0.324577 Nov 14 02:20:34 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 253/766] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:34 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1705 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:35 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7d33a204-5371-42df-934f-9c647b3f066f tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1705 microversion: 2.1 time: 0.158480 Nov 14 02:20:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 257/767] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:34 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1705 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:38 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9a2ef079-ca1a-4dbd-a887-f58b0b516d69 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b" status: 200 len: 1691 microversion: 2.87 time: 0.207250 Nov 14 02:20:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 258/768] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:20:38 2023] GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:20:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ab0f719b-1a46-49b5-8889-8412c3092218 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb2d84c0>, body: {"keypair": {"name": "tempest-keypair-438637596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl7faLyiziutpEyCrhRIdksI+U7pL8LoCdnPmNKFmtcaBmmF4UR1dwk+RU5o1eV6Prup3hKzl11gsZDIVF4WFNlc2j1N2f8xeBCstMWK3/dQVxhOBCuif1TlpGUbmr9Og=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:41 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-ab0f719b-1a46-49b5-8889-8412c3092218 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:20:41 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-ab0f719b-1a46-49b5-8889-8412c3092218 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:20:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-ab0f719b-1a46-49b5-8889-8412c3092218 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176729 Nov 14 02:20:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 254/769] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:20:41 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:42 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b41da20f-7b4d-41c0-ba6d-dca239d4581d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 200 len: 1597 microversion: 2.1 time: 0.264794 Nov 14 02:20:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 258/770] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:42 2023] GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 1597 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:20:42 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2044879744", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5"}], "security_groups": [{"name": "tempest-securitygroup--1998519270"}], "key_name": "tempest-keypair-438637596", "user_data": "}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:42 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] validate_networks() for [('9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:20:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:20:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.635595 Nov 14 02:20:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 259/771] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:20:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:20:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6748e28b-d489-4617-94e7-1048a3fe169c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:43 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6748e28b-d489-4617-94e7-1048a3fe169c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:43 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-6748e28b-d489-4617-94e7-1048a3fe169c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6748e28b-d489-4617-94e7-1048a3fe169c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be" status: 200 len: 1233 microversion: 2.1 time: 0.109700 Nov 14 02:20:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 255/772] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:43 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be => generated 1233 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:20:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Creating event network-changed:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:20:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037469 Nov 14 02:20:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 259/773] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] HTTP exception thrown: Instance c226a1bf-4b89-49e0-ad8f-149849f12639 could not be found. Nov 14 02:20:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Returning 404 to user: Instance c226a1bf-4b89-49e0-ad8f-149849f12639 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:20:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-33f4c344-0deb-4c72-99db-9c5e81eb1694 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639" status: 404 len: 111 microversion: 2.1 time: 0.027192 Nov 14 02:20:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 260/774] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:47 2023] GET /compute/v2.1/servers/c226a1bf-4b89-49e0-ad8f-149849f12639 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:20:47 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=16 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-plugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Creating event network-vif-plugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:20:47 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058406 Nov 14 02:20:47 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 256/775] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-plugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6d5e6d33-b4de-47f7-9d8e-af3e2993b930 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Calling method '.version_select at 0x7fc9eb1bfa30>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Creating event network-vif-plugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:20:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037027 Nov 14 02:20:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 260/776] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-6d5e6d33-b4de-47f7-9d8e-af3e2993b930 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-863039138" status: 202 len: 0 microversion: 2.1 time: 0.028290 Nov 14 02:20:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 261/777] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:20:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-863039138 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:20:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef2a690-6f55-4d15-aac7-323e90b3e232", "name": "network-vif-unplugged", "status": "completed", "tag": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Creating event network-vif-unplugged:0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 on user Nov 14 02:20:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038761 Nov 14 02:20:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 257/778] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef2a690-6f55-4d15-aac7-323e90b3e232", "name": "network-vif-deleted", "tag": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] Creating event network-vif-deleted:0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 on user Nov 14 02:20:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038206 Nov 14 02:20:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 261/779] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:53 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:53 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef2a690-6f55-4d15-aac7-323e90b3e232", "name": "network-vif-plugged", "status": "completed", "tag": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Creating event network-vif-plugged:0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 on user Nov 14 02:20:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039356 Nov 14 02:20:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 262/780] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:20:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b0f3cc63-51fb-47dc-9843-7ae46b1fae48 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'create', calling method: .version_select at 0x7fc9eccd0160>, body: {"keypair": {"name": "tempest-keypair-34722916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsFmFIPhOCkXP+VUy2d+niU2Ks7ncJCtipI380Z6fBMTn/cwQN6BjKiVmK+YzwFjPQUOcxjnbmNi7hQtgs8AMfiaBh5aypsW4p/ucVfVfpy5S1RpOX+1GnlAPNw74qPJQ=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:55 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:20:55 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-b0f3cc63-51fb-47dc-9843-7ae46b1fae48 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:20:55 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-b0f3cc63-51fb-47dc-9843-7ae46b1fae48 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for user a5f8a4942cb54c9aa5377e6d2df1aa7b and project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:20:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b0f3cc63-51fb-47dc-9843-7ae46b1fae48 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053278 Nov 14 02:20:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 258/781] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:20:55 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:20:56 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-174000204", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "49124b4f-3521-43c8-bda4-701f450c6b7d"}], "security_groups": [{"name": "tempest-securitygroup--1578200432"}], "key_name": "tempest-keypair-34722916", "user_data": "}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:20:56 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] validate_networks() for [('49124b4f-3521-43c8-bda4-701f450c6b7d', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting quotas for user a5f8a4942cb54c9aa5377e6d2df1aa7b and project 68ac9795cbe748fc8079de4bb8234cd3. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:20:57 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:20:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.515034 Nov 14 02:20:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 262/782] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:20:56 2023] POST /compute/v2.1/servers => generated 407 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:20:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3e908591-78ee-4a42-8ba9-fcbc45d62742 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:20:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3e908591-78ee-4a42-8ba9-fcbc45d62742 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:20:57 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3e908591-78ee-4a42-8ba9-fcbc45d62742 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:20:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3e908591-78ee-4a42-8ba9-fcbc45d62742 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 200 len: 1235 microversion: 2.1 time: 0.083830 Nov 14 02:20:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 263/783] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:20:57 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:21:00 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Creating event network-changed:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:21:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039039 Nov 14 02:21:00 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 259/784] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:21:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029583 Nov 14 02:21:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 263/785] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:04 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:21:04 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Nov 14 02:21:04 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 264/786] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/action" status: 204 len: 0 microversion: 2.1 time: 0.086601 Nov 14 02:21:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 260/787] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:21:06 2023] POST /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:06 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:06 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-071cc1fc-1d07-4c33-8e30-8e28e7d9f52a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1556 microversion: 2.1 time: 0.379999 Nov 14 02:21:06 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 264/788] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:06 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1556 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1382043427"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:19 user devstack@n-api.service[64868]: INFO nova.network.security_group_api [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Removing security group 15ab3d4c-7b60-4bf3-8a87-29c565aadc49 from port fb569262-fb03-4fa0-9d3d-80ab79690476 Nov 14 02:21:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b44ba769-046f-4ae1-b4ee-feb0ae91861f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/action" status: 202 len: 0 microversion: 2.1 time: 0.546454 Nov 14 02:21:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 265/789] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:21:19 2023] POST /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:21:19 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Creating event network-changed:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:21:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038653 Nov 14 02:21:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 261/790] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] HTTP exception thrown: Instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 could not be found. Nov 14 02:21:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Returning 404 to user: Instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:21:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-3211ea65-a30d-41fb-8702-4f684f002a07 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232" status: 404 len: 111 microversion: 2.1 time: 0.046083 Nov 14 02:21:19 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 265/791] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:19 2023] GET /compute/v2.1/servers/0ef2a690-6f55-4d15-aac7-323e90b3e232 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:21:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-01f32a73-2269-4d8a-ae6d-e6bc82a1088a tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '.version_select at 0x7fc9eb1bfe20>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-01f32a73-2269-4d8a-ae6d-e6bc82a1088a tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744969399" status: 202 len: 0 microversion: 2.1 time: 0.020619 Nov 14 02:21:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 266/792] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:21:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744969399 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:20 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'services' on Instance uuid 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:21:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments/006829f8-9e9b-4d9a-a76a-ed873c5b57fb" status: 202 len: 0 microversion: 2.1 time: 0.201723 Nov 14 02:21:20 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 262/793] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:21:20 2023] DELETE /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments/006829f8-9e9b-4d9a-a76a-ed873c5b57fb => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9c920ffa-a8c3-4da3-8290-c7387241a9ab tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053193 Nov 14 02:21:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 266/794] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:21:20 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:21 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Creating event network-changed:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:21:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036772 Nov 14 02:21:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 267/795] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-125e82c5-4fa6-46b8-9228-35f5784a5b80 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb2d8dc0>, body: {"keypair": {"name": "tempest-keypair-817367158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4yKgyDK23ewe450iUs1rZwM21NYHFAcoK312eJ7UUkzY/DPknEhw1XJrr03KJO7BTArPrFwXojLXC/Yubfbl/x+1OBc0kBiaNaT0KVcBwhR2dL31ZDEOK1fyYWhqY5ww=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:26 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-125e82c5-4fa6-46b8-9228-35f5784a5b80 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:21:26 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-125e82c5-4fa6-46b8-9228-35f5784a5b80 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for user 0729cfec73f44f4eafb49d51f9ce01e2 and project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:21:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-125e82c5-4fa6-46b8-9228-35f5784a5b80 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045975 Nov 14 02:21:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 263/796] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:21:26 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1137021199", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2"}], "security_groups": [{"name": "tempest-securitygroup--1348805800"}], "key_name": "tempest-keypair-817367158", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] validate_networks() for [('dfcd5f09-6f3c-4ea6-b88a-76233441a7c2', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting quotas for user 0729cfec73f44f4eafb49d51f9ce01e2 and project fdd36fad5dd04e79a672f69b7e100ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:21:28 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:21:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.789271 Nov 14 02:21:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 267/797] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:21:28 2023] POST /compute/v2.1/servers => generated 404 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:21:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-663fc18a-7e1c-4c97-b797-f0f93c8e2b66 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-663fc18a-7e1c-4c97-b797-f0f93c8e2b66 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:28 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-663fc18a-7e1c-4c97-b797-f0f93c8e2b66 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-663fc18a-7e1c-4c97-b797-f0f93c8e2b66 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea" status: 200 len: 1234 microversion: 2.1 time: 0.070950 Nov 14 02:21:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 268/798] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:28 2023] GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea => generated 1234 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:21:31 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:31 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e9702c-fd13-497e-abb9-bf85703fccea", "tag": "a346a6b6-4287-489f-a426-f26a927d153c"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:31 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Creating event network-changed:a346a6b6-4287-489f-a426-f26a927d153c for instance 59e9702c-fd13-497e-abb9-bf85703fccea on user Nov 14 02:21:31 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096135 Nov 14 02:21:31 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 264/799] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:33 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e9702c-fd13-497e-abb9-bf85703fccea", "name": "network-vif-plugged", "status": "completed", "tag": "a346a6b6-4287-489f-a426-f26a927d153c"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:33 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Creating event network-vif-plugged:a346a6b6-4287-489f-a426-f26a927d153c for instance 59e9702c-fd13-497e-abb9-bf85703fccea on user Nov 14 02:21:33 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034993 Nov 14 02:21:33 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 268/800] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:33 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:33 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-5d28ec73-0493-4dcb-90fd-dc6538013ac1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be" status: 200 len: 1542 microversion: 2.1 time: 0.207063 Nov 14 02:21:33 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 269/801] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:33 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be => generated 1542 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:21:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e9702c-fd13-497e-abb9-bf85703fccea", "name": "network-vif-plugged", "status": "completed", "tag": "a346a6b6-4287-489f-a426-f26a927d153c"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 204 len: 0 microversion: 2.1 time: 0.122456 Nov 14 02:21:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 265/802] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:21:35 2023] DELETE /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:21:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Creating event network-vif-plugged:a346a6b6-4287-489f-a426-f26a927d153c for instance 59e9702c-fd13-497e-abb9-bf85703fccea on user Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031309 Nov 14 02:21:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 269/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-unplugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Creating event network-vif-unplugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:21:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033131 Nov 14 02:21:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 266/804] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:35 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-34347068-37ed-4abe-afb6-21705255cad3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 200 len: 1711 microversion: 2.1 time: 0.315641 Nov 14 02:21:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 270/805] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:35 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 1711 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:21:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-plugged", "status": "completed", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}, {"server_uuid": "ce3a9680-3062-4e7d-8af3-81c31f3f499c", "name": "network-vif-deleted", "tag": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Creating event network-vif-plugged:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:21:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Creating event network-vif-deleted:ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c on user Nov 14 02:21:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031805 Nov 14 02:21:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 270/806] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-899190952"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:39 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/action" status: 202 len: 52 microversion: 2.87 time: 0.883477 Nov 14 02:21:39 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 267/807] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:21:38 2023] POST /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/action => generated 52 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7028c4ee-5678-47f4-80c4-63c2adad7c08 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.168429 Nov 14 02:21:42 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 271/808] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:21:42 2023] GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e/os-interface => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "055ad398-aa12-4378-a63a-e2a3562f661e", "tag": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:43 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:43 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Creating event network-changed:8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance 055ad398-aa12-4378-a63a-e2a3562f661e on user Nov 14 02:21:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034030 Nov 14 02:21:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 271/809] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:43 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c90d6d10-dd81-4301-a18c-c43803a4247c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 200 len: 1597 microversion: 2.1 time: 0.336109 Nov 14 02:21:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 268/810] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:43 2023] GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 1597 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:21:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 204 len: 0 microversion: 2.1 time: 0.164643 Nov 14 02:21:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 272/811] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:21:43 2023] DELETE /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:44 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ca453119-07b4-4c02-8bf0-3bfb100818fd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 200 len: 1722 microversion: 2.1 time: 0.203964 Nov 14 02:21:44 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 272/812] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:44 2023] GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:21:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055ad398-aa12-4378-a63a-e2a3562f661e", "name": "network-vif-unplugged", "status": "completed", "tag": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Creating event network-vif-unplugged:8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance 055ad398-aa12-4378-a63a-e2a3562f661e on user Nov 14 02:21:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038259 Nov 14 02:21:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 269/813] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:45 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a4b91f68-8deb-451d-934d-fadcb037b2ec tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b" status: 200 len: 1691 microversion: 2.87 time: 0.207197 Nov 14 02:21:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 273/814] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:21:45 2023] GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:21:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3aa2abaa-d64a-4b95-a9ea-d5fb4fee1b35 req-f795271b-5e82-4d33-8258-0afeaa549e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055ad398-aa12-4378-a63a-e2a3562f661e", "name": "network-vif-deleted", "tag": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3aa2abaa-d64a-4b95-a9ea-d5fb4fee1b35 req-f795271b-5e82-4d33-8258-0afeaa549e7d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3aa2abaa-d64a-4b95-a9ea-d5fb4fee1b35 req-f795271b-5e82-4d33-8258-0afeaa549e7d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3aa2abaa-d64a-4b95-a9ea-d5fb4fee1b35 req-f795271b-5e82-4d33-8258-0afeaa549e7d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3aa2abaa-d64a-4b95-a9ea-d5fb4fee1b35 req-f795271b-5e82-4d33-8258-0afeaa549e7d service nova] Creating event network-vif-deleted:8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance 055ad398-aa12-4378-a63a-e2a3562f661e on user Nov 14 02:21:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3aa2abaa-d64a-4b95-a9ea-d5fb4fee1b35 req-f795271b-5e82-4d33-8258-0afeaa549e7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 Nov 14 02:21:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 273/815] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055ad398-aa12-4378-a63a-e2a3562f661e", "name": "network-vif-plugged", "status": "completed", "tag": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:21:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Creating event network-vif-plugged:8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance 055ad398-aa12-4378-a63a-e2a3562f661e on user Nov 14 02:21:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029969 Nov 14 02:21:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 270/816] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:47 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b036d1a4-95ce-48bb-bf00-3e35c06d1101 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 200 len: 1549 microversion: 2.1 time: 0.207307 Nov 14 02:21:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 274/817] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:47 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 1549 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=26 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:21:56 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:21:56 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-14b2902e-691d-4032-91cd-f8a636458bcf tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1548 microversion: 2.1 time: 0.209210 Nov 14 02:21:56 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 274/818] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:21:56 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-63c0a388-0b4e-4fc9-831a-a9f3ec646867 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052058 Nov 14 02:22:10 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 271/819] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:22:10 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] HTTP exception thrown: Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c is not attached to volume 006829f8-9e9b-4d9a-a76a-ed873c5b57fb Nov 14 02:22:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Returning 404 to user: Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c is not attached to volume 006829f8-9e9b-4d9a-a76a-ed873c5b57fb {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:22:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-dc155289-356e-4a3d-854c-f799c988b0e2 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments/006829f8-9e9b-4d9a-a76a-ed873c5b57fb" status: 404 len: 154 microversion: 2.1 time: 0.100600 Nov 14 02:22:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 275/820] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:22:10 2023] DELETE /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c/os-volume_attachments/006829f8-9e9b-4d9a-a76a-ed873c5b57fb => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:11 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:22:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 204 len: 0 microversion: 2.1 time: 0.140627 Nov 14 02:22:12 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 275/821] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:22:11 2023] DELETE /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-unplugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:12 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:12 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-68379e7d-377d-4b9a-8807-12d23b96a1bc tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 200 len: 1540 microversion: 2.1 time: 0.241372 Nov 14 02:22:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:12 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 272/822] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:12 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 1540 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Creating event network-vif-unplugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:22:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031640 Nov 14 02:22:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 276/823] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:13 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-afa5cd9d-0f6a-4f92-8695-847f23858282 req-ed157ff5-aaf6-49b8-aa50-5ba6e960c2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-deleted", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-afa5cd9d-0f6a-4f92-8695-847f23858282 req-ed157ff5-aaf6-49b8-aa50-5ba6e960c2df service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-afa5cd9d-0f6a-4f92-8695-847f23858282 req-ed157ff5-aaf6-49b8-aa50-5ba6e960c2df service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:13 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-afa5cd9d-0f6a-4f92-8695-847f23858282 req-ed157ff5-aaf6-49b8-aa50-5ba6e960c2df service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-afa5cd9d-0f6a-4f92-8695-847f23858282 req-ed157ff5-aaf6-49b8-aa50-5ba6e960c2df service nova] Creating event network-vif-deleted:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:22:13 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-afa5cd9d-0f6a-4f92-8695-847f23858282 req-ed157ff5-aaf6-49b8-aa50-5ba6e960c2df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035202 Nov 14 02:22:13 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 276/824] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:14 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}, {"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}, {"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}, {"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-unplugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}, {"server_uuid": "9e083a62-27d0-4633-a608-7eb34ddafe2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb569262-fb03-4fa0-9d3d-80ab79690476"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:22:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:22:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:22:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Creating event network-vif-unplugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:22:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Creating event network-vif-plugged:fb569262-fb03-4fa0-9d3d-80ab79690476 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c on user Nov 14 02:22:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.047859 Nov 14 02:22:14 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 273/825] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:14 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-777ee460-6565-4c81-8598-21288943cb46 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea" status: 200 len: 1543 microversion: 2.1 time: 0.225450 Nov 14 02:22:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 277/826] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:19 2023] GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea => generated 1543 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] HTTP exception thrown: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. Nov 14 02:22:25 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Returning 404 to user: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:22:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-77b0c625-0cb9-47f6-bcc7-fd661f6e72a4 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 404 len: 111 microversion: 2.1 time: 0.037376 Nov 14 02:22:25 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 277/827] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:25 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=14 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] HTTP exception thrown: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. Nov 14 02:22:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Returning 404 to user: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:22:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f7fc43c4-c334-4128-8d31-3eb7fe8d89e7 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034524 Nov 14 02:22:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 274/828] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:22:25 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] HTTP exception thrown: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. Nov 14 02:22:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Returning 404 to user: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:22:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-8d303dc1-3d71-4df2-b5c3-5948e8da9a10 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 404 len: 111 microversion: 2.1 time: 0.034327 Nov 14 02:22:27 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 278/829] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:22:27 2023] DELETE /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] HTTP exception thrown: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. Nov 14 02:22:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Returning 404 to user: Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:22:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7b566e73-5029-45cb-94e6-4d7c7b22daa3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c" status: 404 len: 111 microversion: 2.1 time: 0.033933 Nov 14 02:22:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 278/830] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:27 2023] GET /compute/v2.1/servers/ce3a9680-3062-4e7d-8af3-81c31f3f499c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:22:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2b813c46-0650-4c95-9e0c-a1cbc3eb9ecc tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Calling method '.version_select at 0x7fc9eb185120>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-2b813c46-0650-4c95-9e0c-a1cbc3eb9ecc tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362037621" status: 202 len: 0 microversion: 2.1 time: 0.025901 Nov 14 02:22:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 275/831] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:22:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362037621 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:33 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:33 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-937dc800-492b-4a2b-9cbb-ebb321c2df73 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.154939 Nov 14 02:22:33 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 279/832] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:22:33 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-interface => generated 282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 055ad398-aa12-4378-a63a-e2a3562f661e could not be found. Nov 14 02:22:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 055ad398-aa12-4378-a63a-e2a3562f661e could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:22:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ffd04bc5-5785-43ac-a113-8a92042f8bfc tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 404 len: 111 microversion: 2.1 time: 0.035019 Nov 14 02:22:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 279/833] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:34 2023] GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:34 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-472d59e5-75dc-46ec-bd4d-e6ca967d1470 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/ips" status: 200 len: 107 microversion: 2.1 time: 0.035798 Nov 14 02:22:34 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 280/834] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:22:34 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/ips => generated 107 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Creating event network-changed:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:22:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177887 Nov 14 02:22:34 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 276/835] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:35 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:22:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 204 len: 0 microversion: 2.1 time: 0.124009 Nov 14 02:22:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 280/836] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:22:35 2023] DELETE /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:35 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-79ad3dce-1b0c-43ee-ba8d-ea7519d9a15a tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 200 len: 1567 microversion: 2.1 time: 0.341743 Nov 14 02:22:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 281/837] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:35 2023] GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 1567 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22b7d354-46a0-4057-ba2c-bf04b07c31e4"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359448 Nov 14 02:22:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 277/838] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:22:36 2023] POST /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987991d7-8a45-49ee-a516-fac07e1d8589", "name": "network-vif-deleted", "tag": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] Creating event network-vif-deleted:3f087bec-f4a3-4cc7-85a4-bbc27914cbae for instance 987991d7-8a45-49ee-a516-fac07e1d8589 on user Nov 14 02:22:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028439 Nov 14 02:22:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 281/839] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-782ec6b9-a9b3-4811-9f5e-5c4eee8d4d71 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb3fbeb0>, body: {"keypair": {"name": "tempest-keypair-1542235845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDtiB1Q/29INzS1Awe+SrgWEvNOe4OsR9c2+ytcV4I9qNI9t4UTFZ3vYkj4sjWDTElkVGfSPjrpMOIeYBmbQit22H7RXOnJXqzHe8TWNNfea+Locbv+beA3JPiwlKqB5A=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:38 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-782ec6b9-a9b3-4811-9f5e-5c4eee8d4d71 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:22:38 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-782ec6b9-a9b3-4811-9f5e-5c4eee8d4d71 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for user d50e0e5a436243f2a91c012a4996185c and project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:22:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-782ec6b9-a9b3-4811-9f5e-5c4eee8d4d71 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.095913 Nov 14 02:22:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 282/840] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 14 02:22:38 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-432527132", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e09cacfd-7877-4055-bd31-ae7e6d56d272"}], "security_groups": [{"name": "tempest-securitygroup--926511135"}], "key_name": "tempest-keypair-1542235845", "user_data": "}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] validate_networks() for [('e09cacfd-7877-4055-bd31-ae7e6d56d272', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for user d50e0e5a436243f2a91c012a4996185c and project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:22:40 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:22:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.621464 Nov 14 02:22:40 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 278/841] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:22:40 2023] POST /compute/v2.1/servers => generated 399 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:22:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-aad840fd-1edb-4d03-bfef-9eb86f933b24 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:40 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-aad840fd-1edb-4d03-bfef-9eb86f933b24 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:40 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-aad840fd-1edb-4d03-bfef-9eb86f933b24 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:40 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-aad840fd-1edb-4d03-bfef-9eb86f933b24 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:40 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-aad840fd-1edb-4d03-bfef-9eb86f933b24 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-aad840fd-1edb-4d03-bfef-9eb86f933b24 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 200 len: 1273 microversion: 2.20 time: 0.068585 Nov 14 02:22:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 282/842] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:22:40 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 1273 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 14 02:22:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Creating event network-changed:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:22:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029161 Nov 14 02:22:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 283/843] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a1133c1f-a098-42fd-8509-45a1a7fe21dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb2dbbe0>, body: {"keypair": {"name": "tempest-keypair-534394893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyP+oGtxHij1jDu5knyUXkkhCO10Kr3wgx1E+1ZMdIoetrpAJi7/mDioMn2T01vMWyRKhkVoaQnkrepY+1+EoZehy+AI67In10R7oubX4qC0uKjONiArFcfumG/sW8TlA=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:44 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-a1133c1f-a098-42fd-8509-45a1a7fe21dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:22:44 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-a1133c1f-a098-42fd-8509-45a1a7fe21dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:22:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a1133c1f-a098-42fd-8509-45a1a7fe21dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060897 Nov 14 02:22:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 279/844] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:22:44 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-plugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Creating event network-vif-plugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:22:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045377 Nov 14 02:22:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 283/845] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-893670019", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "destination_type": "volume"}], "networks": [{"uuid": "02278215-38bd-499d-a1ab-1d2bb873b0ee"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] validate_networks() for [('02278215-38bd-499d-a1ab-1d2bb873b0ee', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1080161757", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5"}], "security_groups": [{"name": "tempest-securitygroup--2012684247"}], "key_name": "tempest-keypair-534394893", "user_data": "}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] validate_networks() for [('9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting quotas for user addcfdac50de4b03bd3ad3142508edea and project ac29176de8fc434285721bbb6759966d. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:22:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.722508 Nov 14 02:22:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 284/846] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:22:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:22:46 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a7fdd302-38a7-426a-8220-6b5647a4697f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:46 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a7fdd302-38a7-426a-8220-6b5647a4697f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:22:46 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-a7fdd302-38a7-426a-8220-6b5647a4697f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:46 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-a7fdd302-38a7-426a-8220-6b5647a4697f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:22:46 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-a7fdd302-38a7-426a-8220-6b5647a4697f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:46 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:22:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a7fdd302-38a7-426a-8220-6b5647a4697f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 200 len: 1394 microversion: 2.87 time: 0.076731 Nov 14 02:22:46 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 284/847] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:22:46 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 1394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:22:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.670691 Nov 14 02:22:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 280/848] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:22:46 2023] POST /compute/v2.1/servers => generated 400 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9cfd02be-a74a-4bf3-8b25-fe43f3a18348 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-9cfd02be-a74a-4bf3-8b25-fe43f3a18348 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:46 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9cfd02be-a74a-4bf3-8b25-fe43f3a18348 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9cfd02be-a74a-4bf3-8b25-fe43f3a18348 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3" status: 200 len: 1233 microversion: 2.1 time: 0.071850 Nov 14 02:22:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 285/849] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:46 2023] GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3 => generated 1233 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:47 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-plugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:47 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Creating event network-vif-plugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:22:47 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030018 Nov 14 02:22:47 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 285/850] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:47 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-27bc77cd-2494-439b-9ee8-7fec6d9baab5 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.200119 Nov 14 02:22:48 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 281/851] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:22:47 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-interface => generated 282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Creating event network-changed:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:22:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033183 Nov 14 02:22:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 286/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Creating event network-changed:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:22:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035306 Nov 14 02:22:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 286/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc412155-c035-4969-aa7f-9e1bc62a4e64"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:50 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcca61ed-4b5a-4966-8584-bde4f1954eb3", "tag": "6e087160-8d8f-4fce-8f06-559aa76e24ad"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Creating event network-changed:6e087160-8d8f-4fce-8f06-559aa76e24ad for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 on user Nov 14 02:22:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097223 Nov 14 02:22:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 282/854] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405244 Nov 14 02:22:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 287/855] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:22:50 2023] POST /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcca61ed-4b5a-4966-8584-bde4f1954eb3", "name": "network-vif-plugged", "status": "completed", "tag": "6e087160-8d8f-4fce-8f06-559aa76e24ad"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Creating event network-vif-plugged:6e087160-8d8f-4fce-8f06-559aa76e24ad for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 on user Nov 14 02:22:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035625 Nov 14 02:22:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 287/856] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:22:54 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcca61ed-4b5a-4966-8584-bde4f1954eb3", "name": "network-vif-plugged", "status": "completed", "tag": "6e087160-8d8f-4fce-8f06-559aa76e24ad"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:54 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Creating event network-vif-plugged:6e087160-8d8f-4fce-8f06-559aa76e24ad for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 on user Nov 14 02:22:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055921 Nov 14 02:22:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 283/857] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:22:56 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:56 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=12 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:57 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-dab0fdb3-8a83-4c3d-bf03-b90348b79593 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1548 microversion: 2.1 time: 0.407079 Nov 14 02:22:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 288/858] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:56 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1548 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "POST /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/action" status: 200 len: 32153 microversion: 2.1 time: 0.235520 Nov 14 02:22:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 288/859] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:22:57 2023] POST /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/action => generated 32153 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=16 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:57 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:58 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-fb2e703b-6d44-4364-bb45-67c2ac0902b2 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1541 microversion: 2.1 time: 0.276366 Nov 14 02:22:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 284/860] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:57 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1541 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:58 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:22:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/action" status: 200 len: 32 microversion: 2.1 time: 0.167516 Nov 14 02:22:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 289/861] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:22:58 2023] POST /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:58 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:22:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ee08327b-23e7-4858-8bfc-3f607b776355 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 200 len: 1719 microversion: 2.1 time: 0.275258 Nov 14 02:22:58 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 289/862] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:22:58 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 1719 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:22:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-unplugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:22:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:22:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:22:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:22:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Creating event network-vif-unplugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:22:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044345 Nov 14 02:22:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 285/863] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:23:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029434 Nov 14 02:23:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 290/864] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:23:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052690 Nov 14 02:23:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 290/865] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] HTTP exception thrown: Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c could not be found. Nov 14 02:23:02 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Returning 404 to user: Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:23:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e6a7d57a-2b43-4ae1-862f-1872e8c8278c tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c" status: 404 len: 111 microversion: 2.1 time: 0.159645 Nov 14 02:23:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 286/866] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:02 2023] GET /compute/v2.1/servers/9e083a62-27d0-4633-a608-7eb34ddafe2c => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:23:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-2f4d60be-ed1b-47f0-9e79-a3265eca7da1 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Calling method '.version_select at 0x7fc9eafb4430>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-2f4d60be-ed1b-47f0-9e79-a3265eca7da1 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1262712773" status: 202 len: 0 microversion: 2.1 time: 0.020919 Nov 14 02:23:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 291/867] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Nov 14 02:23:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1262712773 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:23:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}, {"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:23:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:23:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045067 Nov 14 02:23:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 291/868] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:23:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028894 Nov 14 02:23:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 287/869] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0c5a7657-d8d6-48f5-b5b0-62899a0b142d tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.401982 Nov 14 02:23:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 292/870] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:23:19 2023] GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea/os-interface => generated 283 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:21 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:21 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:21 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e9702c-fd13-497e-abb9-bf85703fccea", "tag": "a346a6b6-4287-489f-a426-f26a927d153c"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Creating event network-changed:a346a6b6-4287-489f-a426-f26a927d153c for instance 59e9702c-fd13-497e-abb9-bf85703fccea on user Nov 14 02:23:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045113 Nov 14 02:23:21 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 292/871] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4bec1fd-74cf-44e0-adf0-05dc7ded5e06", "device": "/dev/vdb"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:21 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511512 Nov 14 02:23:21 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 288/872] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:23:21 2023] POST /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:23 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-98826b3d-279b-4906-a816-d452dd5bdc04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Action: 'create', calling method: .version_select at 0x7fc9eafb69e0>, body: {"keypair": {"name": "tempest-keypair-1580117513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNwTb2urTVLljSFUoM358TkxPplIcLrsExGy4PLF3r4Ehsu6aJYWb+8DHxXrLdPALDpXXE3Ne3ddgazJSGF/eYv9lJy+Pd3Zbm+a5WnOpVXLr8zFO/FMHhkfhV6vc8T9Q=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:23 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-98826b3d-279b-4906-a816-d452dd5bdc04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Getting quotas for project f9aa4951950648f3a648099551dbbd07. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:23:23 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-98826b3d-279b-4906-a816-d452dd5bdc04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Getting quotas for user 3a4b4a5d083c42ff8dffe1308cb04d75 and project f9aa4951950648f3a648099551dbbd07. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:23:23 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-98826b3d-279b-4906-a816-d452dd5bdc04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087222 Nov 14 02:23:23 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 293/873] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:23:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:24 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "a3da3e1b-0b14-41dd-8801-7b05faf6a776"}], "security_groups": [{"name": "tempest-securitygroup--716384264"}], "key_name": "tempest-keypair-1580117513", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] validate_networks() for [('a3da3e1b-0b14-41dd-8801-7b05faf6a776', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Getting quotas for project f9aa4951950648f3a648099551dbbd07. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Getting quotas for user 3a4b4a5d083c42ff8dffe1308cb04d75 and project f9aa4951950648f3a648099551dbbd07. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:23:25 user devstack@n-api.service[64867]: WARNING nova.utils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Hostname tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703 is longer than 63, truncate it to tempest-TestServerVolumeAttachScenarioOldVersion-server-7653787 Nov 14 02:23:25 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:23:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.668395 Nov 14 02:23:25 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 293/874] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:23:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:23:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-67e6061b-7398-4f61-9ab1-c3e10f045efa tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-67e6061b-7398-4f61-9ab1-c3e10f045efa tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:25 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-67e6061b-7398-4f61-9ab1-c3e10f045efa tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4a5d083c42ff8dffe1308cb04d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aa4951950648f3a648099551dbbd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-67e6061b-7398-4f61-9ab1-c3e10f045efa tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae" status: 200 len: 1249 microversion: 2.1 time: 0.102552 Nov 14 02:23:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 289/875] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:25 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 987991d7-8a45-49ee-a516-fac07e1d8589 could not be found. Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 987991d7-8a45-49ee-a516-fac07e1d8589 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:23:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3ea4d6b2-c57d-442c-b224-ce500f93b487 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 404 len: 111 microversion: 2.1 time: 0.032078 Nov 14 02:23:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 294/876] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:25 2023] GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 055ad398-aa12-4378-a63a-e2a3562f661e could not be found. Nov 14 02:23:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 055ad398-aa12-4378-a63a-e2a3562f661e could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:23:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9c005b18-9f74-4ae4-8988-15f2a4a73734 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 404 len: 111 microversion: 2.1 time: 0.036041 Nov 14 02:23:26 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 294/877] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:23:26 2023] DELETE /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 055ad398-aa12-4378-a63a-e2a3562f661e could not be found. Nov 14 02:23:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 055ad398-aa12-4378-a63a-e2a3562f661e could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:23:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-281c65be-c994-4a1b-9c16-1b095d96c1b0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e" status: 404 len: 111 microversion: 2.1 time: 0.030857 Nov 14 02:23:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 290/878] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:26 2023] GET /compute/v2.1/servers/055ad398-aa12-4378-a63a-e2a3562f661e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:23:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-cedf4876-aecf-457f-8123-c257406918e5 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '.version_select at 0x7fc9eafb7d00>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-cedf4876-aecf-457f-8123-c257406918e5 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122805512" status: 202 len: 0 microversion: 2.1 time: 0.027728 Nov 14 02:23:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 295/879] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:23:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122805512 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 987991d7-8a45-49ee-a516-fac07e1d8589 could not be found. Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 987991d7-8a45-49ee-a516-fac07e1d8589 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:23:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ab8c72f1-cfcd-448c-be52-f4d3f65340d4 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 404 len: 111 microversion: 2.1 time: 0.033563 Nov 14 02:23:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 295/880] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:23:27 2023] DELETE /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 987991d7-8a45-49ee-a516-fac07e1d8589 could not be found. Nov 14 02:23:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 987991d7-8a45-49ee-a516-fac07e1d8589 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:23:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-cc86152e-97c8-4357-ba95-87f624bfba8c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589" status: 404 len: 111 microversion: 2.1 time: 0.027472 Nov 14 02:23:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 291/881] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:27 2023] GET /compute/v2.1/servers/987991d7-8a45-49ee-a516-fac07e1d8589 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:23:27 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fede93f2-7c25-4f99-818d-ca903f2410cd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '.version_select at 0x7fc9e8630040>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:27 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fede93f2-7c25-4f99-818d-ca903f2410cd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627011863" status: 202 len: 0 microversion: 2.1 time: 0.028960 Nov 14 02:23:27 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 296/882] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:23:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627011863 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f74c8b67-d65b-4906-918f-25996a06ab41 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb0f1ea0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1177175426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-f74c8b67-d65b-4906-918f-25996a06ab41 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:23:27 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-f74c8b67-d65b-4906-918f-25996a06ab41 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:23:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f74c8b67-d65b-4906-918f-25996a06ab41 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.121699 Nov 14 02:23:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 296/883] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:23:27 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2776db-0245-4ee0-ade9-8b87eaa44fae", "tag": "1fecad81-6dfa-495c-97d9-ebbdbb903a58"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Creating event network-changed:1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae on user Nov 14 02:23:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032366 Nov 14 02:23:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 292/884] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:30 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2776db-0245-4ee0-ade9-8b87eaa44fae", "name": "network-vif-plugged", "status": "completed", "tag": "1fecad81-6dfa-495c-97d9-ebbdbb903a58"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:30 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:30 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Creating event network-vif-plugged:1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae on user Nov 14 02:23:30 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061085 Nov 14 02:23:30 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 297/885] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:31 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:31 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:31 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8f2d9b73-84bf-4396-8ba4-6d22ce89520b tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 200 len: 1584 microversion: 2.20 time: 0.233835 Nov 14 02:23:31 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 297/886] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:23:30 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 1584 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1850980078", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-905371829"}], "block_device_mapping_v2": [{"uuid": "655abaca-9817-45dd-9bf8-480d3b8aeba8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1177175426", "networks": [{"uuid": "82975375-7a5b-4666-9ca1-d92490943dd9"}]}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] validate_networks() for [('82975375-7a5b-4666-9ca1-d92490943dd9', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:23:32 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2776db-0245-4ee0-ade9-8b87eaa44fae", "name": "network-vif-plugged", "status": "completed", "tag": "1fecad81-6dfa-495c-97d9-ebbdbb903a58"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Creating event network-vif-plugged:1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae on user Nov 14 02:23:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029166 Nov 14 02:23:32 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 298/887] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:23:32 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:23:33 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:23:33 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='655abaca-9817-45dd-9bf8-480d3b8aeba8',volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:23:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.891367 Nov 14 02:23:33 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 293/888] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:23:32 2023] POST /compute/v2.1/servers => generated 403 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:23:33 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6c3a6736-cc11-4639-a74c-40ead2d91d3c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:33 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6c3a6736-cc11-4639-a74c-40ead2d91d3c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:33 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-6c3a6736-cc11-4639-a74c-40ead2d91d3c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:33 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6c3a6736-cc11-4639-a74c-40ead2d91d3c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 200 len: 1088 microversion: 2.1 time: 0.094392 Nov 14 02:23:33 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 298/889] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:33 2023] GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:35 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'services' on Instance uuid 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:23:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea/os-volume_attachments/c4bec1fd-74cf-44e0-adf0-05dc7ded5e06" status: 202 len: 0 microversion: 2.1 time: 0.172550 Nov 14 02:23:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 299/890] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:23:35 2023] DELETE /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea/os-volume_attachments/c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:23:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea" status: 204 len: 0 microversion: 2.1 time: 0.168079 Nov 14 02:23:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 294/891] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:23:35 2023] DELETE /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:35 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6c2d161b-2f94-46de-9978-b763ac33bd27 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea" status: 200 len: 1713 microversion: 2.1 time: 0.256449 Nov 14 02:23:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 299/892] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:35 2023] GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea => generated 1713 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:23:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335", "tag": "b8682a57-3293-47b6-9a6a-1149d39ceb33"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Creating event network-changed:b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 on user Nov 14 02:23:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032005 Nov 14 02:23:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 300/893] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:37 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:37 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:37 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0d8fb377-28ce-4044-99f1-5bc97717ccc9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 200 len: 1768 microversion: 2.87 time: 0.319934 Nov 14 02:23:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 295/894] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:23:36 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 1768 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:23:37 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-4b306370-4ec0-4a07-af7f-237064075366 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3" status: 200 len: 1542 microversion: 2.1 time: 0.278655 Nov 14 02:23:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 300/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:36 2023] GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3 => generated 1542 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:23:42 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335", "name": "network-vif-plugged", "status": "completed", "tag": "b8682a57-3293-47b6-9a6a-1149d39ceb33"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Creating event network-vif-plugged:b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 on user Nov 14 02:23:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043123 Nov 14 02:23:42 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 301/896] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335", "name": "network-vif-plugged", "status": "completed", "tag": "b8682a57-3293-47b6-9a6a-1149d39ceb33"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Creating event network-vif-plugged:b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 on user Nov 14 02:23:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Nov 14 02:23:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 296/897] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:48 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=12 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:48 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:48 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=26 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:49 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-cdabeaa9-3616-4f6a-854b-42f27890df96 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 200 len: 1699 microversion: 2.1 time: 0.350319 Nov 14 02:23:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 301/898] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:48 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 1699 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:23:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e9702c-fd13-497e-abb9-bf85703fccea", "name": "network-vif-unplugged", "status": "completed", "tag": "a346a6b6-4287-489f-a426-f26a927d153c"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Creating event network-vif-unplugged:a346a6b6-4287-489f-a426-f26a927d153c for instance 59e9702c-fd13-497e-abb9-bf85703fccea on user Nov 14 02:23:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039372 Nov 14 02:23:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 302/899] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:58 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:23:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 204 len: 0 microversion: 2.1 time: 0.134832 Nov 14 02:23:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 297/900] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:23:58 2023] DELETE /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:58 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:23:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c1a811e6-d5a1-4643-aa42-0d2e323c1f46 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 200 len: 1554 microversion: 2.1 time: 0.211498 Nov 14 02:23:58 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 302/901] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:23:58 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:23:59 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e9702c-fd13-497e-abb9-bf85703fccea", "name": "network-vif-deleted", "tag": "a346a6b6-4287-489f-a426-f26a927d153c"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] Creating event network-vif-deleted:a346a6b6-4287-489f-a426-f26a927d153c for instance 59e9702c-fd13-497e-abb9-bf85703fccea on user Nov 14 02:23:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042001 Nov 14 02:23:59 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 303/902] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:23:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e9702c-fd13-497e-abb9-bf85703fccea", "name": "network-vif-plugged", "status": "completed", "tag": "a346a6b6-4287-489f-a426-f26a927d153c"}, {"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-unplugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}, {"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-plugged", "status": "completed", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:23:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:23:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:23:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:23:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Creating event network-vif-plugged:a346a6b6-4287-489f-a426-f26a927d153c for instance 59e9702c-fd13-497e-abb9-bf85703fccea on user Nov 14 02:23:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Creating event network-vif-unplugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:23:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Creating event network-vif-plugged:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:23:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.050434 Nov 14 02:23:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 298/903] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:23:59 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:01 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-5bf5371d-d16e-4f1f-9e6f-f0876b030efd req-b9c07113-5e13-4a94-820d-02e6bdcd1c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8b16a-a1f1-4625-a715-e5e8bd87d66b", "name": "network-vif-deleted", "tag": "36f42e8b-2ba5-49e9-9966-67431aed797f"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-5bf5371d-d16e-4f1f-9e6f-f0876b030efd req-b9c07113-5e13-4a94-820d-02e6bdcd1c16 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-5bf5371d-d16e-4f1f-9e6f-f0876b030efd req-b9c07113-5e13-4a94-820d-02e6bdcd1c16 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:01 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-5bf5371d-d16e-4f1f-9e6f-f0876b030efd req-b9c07113-5e13-4a94-820d-02e6bdcd1c16 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-5bf5371d-d16e-4f1f-9e6f-f0876b030efd req-b9c07113-5e13-4a94-820d-02e6bdcd1c16 service nova] Creating event network-vif-deleted:36f42e8b-2ba5-49e9-9966-67431aed797f for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b on user Nov 14 02:24:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-5bf5371d-d16e-4f1f-9e6f-f0876b030efd req-b9c07113-5e13-4a94-820d-02e6bdcd1c16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Nov 14 02:24:01 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 303/904] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:16 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4a5d083c42ff8dffe1308cb04d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aa4951950648f3a648099551dbbd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d1f0dd1d-66e1-4f22-8806-7d60b0a500a3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae" status: 200 len: 1573 microversion: 2.1 time: 0.336278 Nov 14 02:24:16 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 304/905] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:15 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae => generated 1573 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:23 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:23 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6cd7265b-4fff-4788-ac8d-cd1e3a5761c9 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 200 len: 1441 microversion: 2.1 time: 0.231762 Nov 14 02:24:23 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 299/906] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:23 2023] GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 1441 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=14 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] HTTP exception thrown: Instance 59e9702c-fd13-497e-abb9-bf85703fccea could not be found. Nov 14 02:24:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Returning 404 to user: Instance 59e9702c-fd13-497e-abb9-bf85703fccea could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:24:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-1fc44565-90a7-4ab0-af5e-a7d62662f852 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea" status: 404 len: 111 microversion: 2.1 time: 0.035142 Nov 14 02:24:26 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 304/907] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:26 2023] GET /compute/v2.1/servers/59e9702c-fd13-497e-abb9-bf85703fccea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:24:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d1d22dfd-aac9-4add-8311-85c56ff43aa7 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Calling method '.version_select at 0x7fc9eb1bd480>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:26 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d1d22dfd-aac9-4add-8311-85c56ff43aa7 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817367158" status: 202 len: 0 microversion: 2.1 time: 0.028614 Nov 14 02:24:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 305/908] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:24:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817367158 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:31 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:31 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-ef5c99dd-e8c6-4ed3-a2a6-d854e35fbfc0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.211025 Nov 14 02:24:31 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 300/909] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:24:31 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-interface => generated 282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:24:32 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:32 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Creating event network-changed:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:24:32 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044502 Nov 14 02:24:32 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 305/910] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c9922dac-e6be-47dc-b4dc-3d1c6ef08ac5 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/ips" status: 200 len: 110 microversion: 2.20 time: 0.044553 Nov 14 02:24:32 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 306/911] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 14 02:24:32 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/ips => generated 110 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:34 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'flavor' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:24:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/action" status: 202 len: 0 microversion: 2.20 time: 0.839687 Nov 14 02:24:34 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 301/912] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:24:34 2023] POST /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:35 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:35 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:35 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:35 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-02e5dd64-c167-4920-a011-5d78afc5cd14 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 200 len: 1709 microversion: 2.20 time: 0.190819 Nov 14 02:24:35 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 306/913] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:24:34 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:24:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-unplugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Creating event network-vif-unplugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:24:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035348 Nov 14 02:24:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 307/914] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:24:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-plugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Creating event network-vif-plugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:24:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029772 Nov 14 02:24:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 302/915] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9baef254-4bea-4669-a17b-3bfa0ac30b49 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.140779 Nov 14 02:24:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 307/916] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:24:37 2023] GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3/os-interface => generated 282 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "c6ac23a8-2afc-4e56-9495-c0c69cee6fd1"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:37 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'flavor' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:24:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac/action" status: 200 len: 29 microversion: 2.87 time: 0.437446 Nov 14 02:24:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 308/917] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:24:37 2023] POST /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac/action => generated 29 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcca61ed-4b5a-4966-8584-bde4f1954eb3", "tag": "6e087160-8d8f-4fce-8f06-559aa76e24ad"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Creating event network-changed:6e087160-8d8f-4fce-8f06-559aa76e24ad for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 on user Nov 14 02:24:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039912 Nov 14 02:24:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 308/918] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5ec3c87a-7433-4607-8491-8c35b1d30f68 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 200 len: 1774 microversion: 2.87 time: 0.362162 Nov 14 02:24:38 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 303/919] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:24:38 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 1774 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-910330cd-4849-4284-9d01-3fc5684b2038 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3/ips" status: 200 len: 107 microversion: 2.1 time: 0.046579 Nov 14 02:24:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 309/920] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:24:38 2023] GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3/ips => generated 107 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22b7d354-46a0-4057-ba2c-bf04b07c31e4"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Invalid volume: volume 22b7d354-46a0-4057-ba2c-bf04b07c31e4 is already attached to instances: 6bc79fc1-8d23-443f-99b5-2464e115a1be Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 400 to user: Invalid volume: volume 22b7d354-46a0-4057-ba2c-bf04b07c31e4 is already attached to instances: 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:24:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5eec158a-0684-4dc0-ba7f-1b66d6b74530 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.203734 Nov 14 02:24:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 309/921] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:24:38 2023] POST /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3/os-volume_attachments => generated 174 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:24:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3" status: 204 len: 0 microversion: 2.1 time: 0.150625 Nov 14 02:24:38 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 304/922] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:24:38 2023] DELETE /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-unplugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Creating event network-vif-unplugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:24:38 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049752 Nov 14 02:24:38 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 310/923] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:39 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:39 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-cfb65e2a-d2f2-4d7d-bb41-74bb922f2cfb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3" status: 200 len: 1667 microversion: 2.1 time: 0.208387 Nov 14 02:24:39 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 310/924] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:38 2023] GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3 => generated 1667 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:24:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}, {"server_uuid": "dcca61ed-4b5a-4966-8584-bde4f1954eb3", "name": "network-vif-unplugged", "status": "completed", "tag": "6e087160-8d8f-4fce-8f06-559aa76e24ad"}, {"server_uuid": "dcca61ed-4b5a-4966-8584-bde4f1954eb3", "name": "network-vif-plugged", "status": "completed", "tag": "6e087160-8d8f-4fce-8f06-559aa76e24ad"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:24:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Creating event network-vif-unplugged:6e087160-8d8f-4fce-8f06-559aa76e24ad for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 on user Nov 14 02:24:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Creating event network-vif-plugged:6e087160-8d8f-4fce-8f06-559aa76e24ad for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 on user Nov 14 02:24:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.041866 Nov 14 02:24:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 305/925] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:40 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:24:41 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:41 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Creating event network-changed:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:24:41 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031989 Nov 14 02:24:41 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 311/926] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-7b57c41a-20fe-4c65-9e58-6b7e51151c93 req-34497752-1a99-4abc-a56d-76df06d9e7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcca61ed-4b5a-4966-8584-bde4f1954eb3", "name": "network-vif-deleted", "tag": "6e087160-8d8f-4fce-8f06-559aa76e24ad"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7b57c41a-20fe-4c65-9e58-6b7e51151c93 req-34497752-1a99-4abc-a56d-76df06d9e7ce service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7b57c41a-20fe-4c65-9e58-6b7e51151c93 req-34497752-1a99-4abc-a56d-76df06d9e7ce service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7b57c41a-20fe-4c65-9e58-6b7e51151c93 req-34497752-1a99-4abc-a56d-76df06d9e7ce service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7b57c41a-20fe-4c65-9e58-6b7e51151c93 req-34497752-1a99-4abc-a56d-76df06d9e7ce service nova] Creating event network-vif-deleted:6e087160-8d8f-4fce-8f06-559aa76e24ad for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 on user Nov 14 02:24:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-7b57c41a-20fe-4c65-9e58-6b7e51151c93 req-34497752-1a99-4abc-a56d-76df06d9e7ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028904 Nov 14 02:24:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 311/927] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:45 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}, {"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:24:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:24:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034796 Nov 14 02:24:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 306/928] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HTTP exception thrown: Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b could not be found. Nov 14 02:24:48 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Returning 404 to user: Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:24:48 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d10e7a0e-c778-43b5-9657-1174d4fa2d44 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 404 len: 111 microversion: 2.1 time: 0.062708 Nov 14 02:24:48 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 312/929] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:48 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HTTP exception thrown: Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b could not be found. Nov 14 02:24:48 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Returning 404 to user: Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:24:48 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-17bddabc-c980-4229-9ed4-eae41c360fde tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 404 len: 111 microversion: 2.1 time: 0.050411 Nov 14 02:24:48 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 312/930] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:24:48 2023] DELETE /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HTTP exception thrown: Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b could not be found. Nov 14 02:24:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Returning 404 to user: Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:24:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-16c96860-3e40-4520-a114-d3ef665f385c tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b" status: 404 len: 111 microversion: 2.1 time: 0.038346 Nov 14 02:24:48 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 307/931] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:48 2023] GET /compute/v2.1/servers/90d8b16a-a1f1-4625-a715-e5e8bd87d66b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 14f49370-77df-4e76-8e1d-4f89580315a4 while it is in vm_state rescued Nov 14 02:24:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Returning 409 to user: Cannot 'detach_volume' instance 14f49370-77df-4e76-8e1d-4f89580315a4 while it is in vm_state rescued {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:24:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-5bad4f3a-3433-406a-b137-198508b46421 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments/fc412155-c035-4969-aa7f-9e1bc62a4e64" status: 409 len: 152 microversion: 2.1 time: 0.114620 Nov 14 02:24:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 313/932] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:24:49 2023] DELETE /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments/fc412155-c035-4969-aa7f-9e1bc62a4e64 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/action" status: 202 len: 0 microversion: 2.1 time: 0.073814 Nov 14 02:24:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 313/933] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:24:49 2023] POST /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:50 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-4880c24b-8d3a-40ab-b74d-7650405675d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 200 len: 1707 microversion: 2.1 time: 0.428764 Nov 14 02:24:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 308/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:49 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 1707 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:24:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-unplugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Creating event network-vif-unplugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:24:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038873 Nov 14 02:24:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 314/935] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:51 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:24:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 204 len: 0 microversion: 2.1 time: 0.150460 Nov 14 02:24:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 314/936] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:24:51 2023] DELETE /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:51 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:24:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-9e0d1871-68aa-48c1-8e78-d1dedbf2d244 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 200 len: 1547 microversion: 2.1 time: 0.230488 Nov 14 02:24:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 309/937] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:24:51 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 1547 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:24:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "name": "network-vif-unplugged", "status": "completed", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Creating event network-vif-unplugged:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:24:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040866 Nov 14 02:24:51 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 315/938] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:24:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036474 Nov 14 02:24:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 315/939] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:53 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "name": "network-vif-deleted", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] Creating event network-vif-deleted:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:24:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035146 Nov 14 02:24:53 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 310/940] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9", "name": "network-vif-plugged", "status": "completed", "tag": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Creating event network-vif-plugged:305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 on user Nov 14 02:24:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033151 Nov 14 02:24:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 316/941] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:24:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}, {"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:24:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:24:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:24:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:24:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:24:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:24:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038984 Nov 14 02:24:54 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 316/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:04 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:04 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-eaee4d30-a163-4025-9e7d-65a7b13ffed1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Action: 'create', calling method: .version_select at 0x7fc9ec100dc0>, body: {"keypair": {"name": "tempest-keypair-1055575446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbyFDCLZjgfq+BHFlU+u5qU3pNwn+VrEWZP3k7XoYudOojzEOn6QNKy+4ixzPXb9ct7wd5zaqdaBlNS3NNvOQH5wRd4E8zalWV8GSDwmgErF1VE1iB8oUkqj4G9wkK7Dw=="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:04 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-eaee4d30-a163-4025-9e7d-65a7b13ffed1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting quotas for project d02ec183414b420e8758ffea80902171. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:25:04 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-eaee4d30-a163-4025-9e7d-65a7b13ffed1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting quotas for user b2a805502f5d4186a0ade4f44bd0d161 and project d02ec183414b420e8758ffea80902171. Resources: {'key_pairs'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:25:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-eaee4d30-a163-4025-9e7d-65a7b13ffed1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.261839 Nov 14 02:25:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 311/943] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:25:04 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-851489065", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "key_name": "tempest-keypair-1055575446", "security_groups": [{"name": "tempest-secgroup-smoke-949661551"}, {"name": "tempest-securitygroup--615950554"}], "networks": [{"uuid": "3a6db057-93ae-4771-b205-bcf29044c756"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] validate_networks() for [('3a6db057-93ae-4771-b205-bcf29044c756', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting quotas for project d02ec183414b420e8758ffea80902171. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting quotas for user b2a805502f5d4186a0ade4f44bd0d161 and project d02ec183414b420e8758ffea80902171. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:25:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:25:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 449 microversion: 2.1 time: 0.597094 Nov 14 02:25:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 317/944] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:25:07 2023] POST /compute/v2.1/servers => generated 449 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:25:07 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:07 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-09f0d343-a5e6-4271-ab2c-286c683c649c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:07 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-09f0d343-a5e6-4271-ab2c-286c683c649c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:08 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-09f0d343-a5e6-4271-ab2c-286c683c649c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a805502f5d4186a0ade4f44bd0d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02ec183414b420e8758ffea80902171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-09f0d343-a5e6-4271-ab2c-286c683c649c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1" status: 200 len: 1235 microversion: 2.1 time: 0.072649 Nov 14 02:25:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 317/945] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:07 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1 => generated 1235 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:10 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053d9dbc-02cd-49b3-9476-02b32b4cb4a1", "tag": "a2de0a50-a398-4b3b-86a8-86137531ca29"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Creating event network-changed:a2de0a50-a398-4b3b-86a8-86137531ca29 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 on user Nov 14 02:25:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033129 Nov 14 02:25:10 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 312/946] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053d9dbc-02cd-49b3-9476-02b32b4cb4a1", "name": "network-vif-plugged", "status": "completed", "tag": "a2de0a50-a398-4b3b-86a8-86137531ca29"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:12 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Creating event network-vif-plugged:a2de0a50-a398-4b3b-86a8-86137531ca29 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 on user Nov 14 02:25:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070302 Nov 14 02:25:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 318/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:14 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053d9dbc-02cd-49b3-9476-02b32b4cb4a1", "name": "network-vif-plugged", "status": "completed", "tag": "a2de0a50-a398-4b3b-86a8-86137531ca29"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:14 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Creating event network-vif-plugged:a2de0a50-a398-4b3b-86a8-86137531ca29 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 on user Nov 14 02:25:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039334 Nov 14 02:25:14 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 318/948] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:16 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-85b720a8-ee8c-4f6c-bace-299370f898e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.139717 Nov 14 02:25:16 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 313/949] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:25:16 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-interface => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2776db-0245-4ee0-ade9-8b87eaa44fae", "tag": "1fecad81-6dfa-495c-97d9-ebbdbb903a58"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Creating event network-changed:1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae on user Nov 14 02:25:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036601 Nov 14 02:25:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 319/950] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:17 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4a5d083c42ff8dffe1308cb04d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aa4951950648f3a648099551dbbd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-d8b08a15-a273-490e-b067-f4112cc1248e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae" status: 200 len: 1573 microversion: 2.1 time: 0.283775 Nov 14 02:25:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 319/951] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:17 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae => generated 1573 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a4b4a5d083c42ff8dffe1308cb04d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aa4951950648f3a648099551dbbd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Searching by: {'deleted': False, 'project_id': 'f9aa4951950648f3a648099551dbbd07'} {{(pid=64866) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:17 user devstack@n-api.service[64866]: DEBUG nova.compute.multi_cell_list [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64866) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 14 02:25:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-61a27a7a-e674-4fb9-9f67-827d61bcbdc6 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 356 microversion: 2.1 time: 0.070789 Nov 14 02:25:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 314/952] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 14 02:25:17 2023] GET /compute/v2.1/servers => generated 356 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95376504-c9da-4f60-83ad-bbc0fec363ca"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270673 Nov 14 02:25:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 320/953] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:25:19 2023] POST /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:24 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:24 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-06b44662-3c5e-4501-bb9a-77cfa6d150d8 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 200 len: 1441 microversion: 2.1 time: 0.350059 Nov 14 02:25:24 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 320/954] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:23 2023] GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 1441 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:25 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-81f815ea-d24f-446e-ab87-2f82d51c0302 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 200 len: 1650 microversion: 2.20 time: 0.201277 Nov 14 02:25:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 315/955] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:25:25 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 1650 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:25:25 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335", "tag": "b8682a57-3293-47b6-9a6a-1149d39ceb33"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:25 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Creating event network-changed:b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 on user Nov 14 02:25:25 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032259 Nov 14 02:25:25 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 321/956] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:25:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 204 len: 0 microversion: 2.1 time: 0.125831 Nov 14 02:25:26 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 321/957] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:25:26 2023] DELETE /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG nova.compute.api [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-066e67eb-41a6-43b0-b86b-27e27e5d06d9 req-137901f6-396d-43ce-948a-e3e975156630 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca" status: 200 len: 302 microversion: 2.89 time: 0.091592 Nov 14 02:25:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 316/958] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:25:26 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca => generated 302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335", "name": "network-vif-unplugged", "status": "completed", "tag": "b8682a57-3293-47b6-9a6a-1149d39ceb33"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG nova.compute.api [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Creating event network-vif-unplugged:b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 on user Nov 14 02:25:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039870 Nov 14 02:25:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 317/959] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:26 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2733d311-d0e2-4a40-b143-041ce384698b req-e1350d7a-be95-4cac-9c2c-22eec0d6d8e3 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca" status: 200 len: 302 microversion: 2.89 time: 0.101760 Nov 14 02:25:26 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 322/960] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 14 02:25:26 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca => generated 302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:26 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-8a16be45-e0d6-4ff7-9fe1-63857514a4ca tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 200 len: 1565 microversion: 2.1 time: 0.497454 Nov 14 02:25:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 322/961] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:26 2023] GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 1565 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:27 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lazy-loading 'services' on Instance uuid 4d2776db-0245-4ee0-ade9-8b87eaa44fae {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:25:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca" status: 202 len: 0 microversion: 2.1 time: 0.196920 Nov 14 02:25:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 318/962] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:25:26 2023] DELETE /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c097cb86-af47-420f-a88f-d49ed19795c1 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047213 Nov 14 02:25:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 323/963] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:25:27 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:28 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a61f42a2-89e7-4ab4-993a-6a9e476dc686 req-cf8d9f96-8a35-4f3c-978a-e4165fe1429a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335", "name": "network-vif-deleted", "tag": "b8682a57-3293-47b6-9a6a-1149d39ceb33"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a61f42a2-89e7-4ab4-993a-6a9e476dc686 req-cf8d9f96-8a35-4f3c-978a-e4165fe1429a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a61f42a2-89e7-4ab4-993a-6a9e476dc686 req-cf8d9f96-8a35-4f3c-978a-e4165fe1429a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a61f42a2-89e7-4ab4-993a-6a9e476dc686 req-cf8d9f96-8a35-4f3c-978a-e4165fe1429a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a61f42a2-89e7-4ab4-993a-6a9e476dc686 req-cf8d9f96-8a35-4f3c-978a-e4165fe1429a service nova] Creating event network-vif-deleted:b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 on user Nov 14 02:25:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a61f42a2-89e7-4ab4-993a-6a9e476dc686 req-cf8d9f96-8a35-4f3c-978a-e4165fe1429a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029528 Nov 14 02:25:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 319/964] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:28 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-81cbe42e-fbd6-43c0-9e66-02d2ce6bd0d9 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 200 len: 1754 microversion: 2.87 time: 0.246210 Nov 14 02:25:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 323/965] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:25:28 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:25:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335", "name": "network-vif-plugged", "status": "completed", "tag": "b8682a57-3293-47b6-9a6a-1149d39ceb33"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Creating event network-vif-plugged:b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 on user Nov 14 02:25:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028374 Nov 14 02:25:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 324/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 could not be found. Nov 14 02:25:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d8c8cf9b-3e62-4617-bc72-5e9d9b9b2af6 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3" status: 404 len: 111 microversion: 2.1 time: 0.026614 Nov 14 02:25:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 320/967] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:29 2023] GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:25:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d96d9526-ba84-44fb-be30-93a94b30b725 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '.version_select at 0x7fc9e8632a70>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d96d9526-ba84-44fb-be30-93a94b30b725 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-534394893" status: 202 len: 0 microversion: 2.1 time: 0.030220 Nov 14 02:25:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 324/968] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:25:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-534394893 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:30 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'services' on Instance uuid 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:25:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments/22b7d354-46a0-4057-ba2c-bf04b07c31e4" status: 202 len: 0 microversion: 2.1 time: 0.164026 Nov 14 02:25:30 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 325/969] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:25:30 2023] DELETE /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments/22b7d354-46a0-4057-ba2c-bf04b07c31e4 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:30 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:30 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-70e6e7c2-d49e-4f61-aa12-ca8d661f7dab tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Nov 14 02:25:30 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 321/970] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:25:30 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:40 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-e58dc8a0-6825-474a-baf2-581c7ed31434 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 200 len: 1713 microversion: 2.1 time: 0.205020 Nov 14 02:25:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 325/971] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:40 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 1713 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HTTP exception thrown: Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 could not be found. Nov 14 02:25:41 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Returning 404 to user: Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6defc8c5-f32c-4f7b-910d-428636fe1749 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" status: 404 len: 111 microversion: 2.1 time: 0.039073 Nov 14 02:25:41 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 326/972] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:41 2023] GET /compute/v2.1/servers/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:25:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0307ff4a-c15d-42b8-b59a-05fd6a129849 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Calling method '.version_select at 0x7fc9eb187910>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:41 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:41 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0307ff4a-c15d-42b8-b59a-05fd6a129849 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627475945" status: 202 len: 0 microversion: 2.1 time: 0.031326 Nov 14 02:25:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 322/973] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:25:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627475945 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:25:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-de83dd4c-4bc0-4d14-8960-cb0287851ca2 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eb1bf370>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-de83dd4c-4bc0-4d14-8960-cb0287851ca2 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d0d2db13-7663-497a-9a34-fcd0786f63b4" status: 200 len: 351 microversion: 2.1 time: 0.210150 Nov 14 02:25:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 326/974] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:25:47 2023] GET /compute/v2.1/os-volumes/d0d2db13-7663-497a-9a34-fcd0786f63b4 => generated 351 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-45659b20-d942-4122-8b65-daf45051dfe8 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eb152440>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-45659b20-d942-4122-8b65-daf45051dfe8 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0e1e8984-96e4-45ad-b277-32ca0f8d1898" status: 200 len: 350 microversion: 2.1 time: 0.109319 Nov 14 02:25:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 327/975] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:25:49 2023] GET /compute/v2.1/os-volumes/0e1e8984-96e4-45ad-b277-32ca0f8d1898 => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:50 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-4d78f4ba-1131-4817-b060-48a5a8bed311 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eb184550>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-4d78f4ba-1131-4817-b060-48a5a8bed311 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/de38f5b8-396d-405f-aeb5-97659dc62141" status: 200 len: 351 microversion: 2.1 time: 0.106412 Nov 14 02:25:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 323/976] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:25:50 2023] GET /compute/v2.1/os-volumes/de38f5b8-396d-405f-aeb5-97659dc62141 => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:50 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:50 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bec44d9f-ab88-40b5-adc0-afe7b8ba1c92 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9e8633c70>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bec44d9f-ab88-40b5-adc0-afe7b8ba1c92 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096949 Nov 14 02:25:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 327/977] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 14 02:25:50 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:50 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-36c91aa1-bf1d-4ca8-8374-831e8fed9985 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eaf41a20>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-36c91aa1-bf1d-4ca8-8374-831e8fed9985 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107157 Nov 14 02:25:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 328/978] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Nov 14 02:25:50 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e6e79998-c141-4d34-a028-771be4d39f79 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eb184670>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e6e79998-c141-4d34-a028-771be4d39f79 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088669 Nov 14 02:25:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 324/979] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 14 02:25:51 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-87112bb8-fa83-4c79-addf-56537cd3f876 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eb1be560>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-87112bb8-fa83-4c79-addf-56537cd3f876 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087525 Nov 14 02:25:51 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 328/980] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Nov 14 02:25:51 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a7701b44-42da-4b02-99bf-d6137e5b389f tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eaf420e0>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a7701b44-42da-4b02-99bf-d6137e5b389f tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085057 Nov 14 02:25:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 329/981] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Nov 14 02:25:51 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5d2e12db-bcc8-4600-9ff2-cb40a256bdcb tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eaf43f40>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5d2e12db-bcc8-4600-9ff2-cb40a256bdcb tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.076744 Nov 14 02:25:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 325/982] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 14 02:25:51 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:25:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d8d4a351-17e5-4d7e-bbe3-348049adadf3 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eafb4430>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d8d4a351-17e5-4d7e-bbe3-348049adadf3 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.079824 Nov 14 02:25:51 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 329/983] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Nov 14 02:25:51 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:25:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c5511ea4-c10f-4b29-a3fc-6cb6a544c823 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] Calling method '.version_select at 0x7fc9eaf42440>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:51 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:51 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c5511ea4-c10f-4b29-a3fc-6cb6a544c823 tempest-VolumesTestJSON-1046805452 tempest-VolumesTestJSON-1046805452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.076523 Nov 14 02:25:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 330/984] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 14 02:25:51 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:25:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c67359d2-583e-4d3f-8d49-34e904e4c7de tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb2da8c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1713960242", "metadata": {"Type": "work"}}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c67359d2-583e-4d3f-8d49-34e904e4c7de tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c67359d2-583e-4d3f-8d49-34e904e4c7de tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.168680 Nov 14 02:25:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 326/985] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 14 02:25:57 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-20a074b3-698c-4ba3-bbc5-b7569d826cc3 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Action: 'create', calling method: .version_select at 0x7fc9eafb5240>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-330586644", "metadata": {"Type": "work"}}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-20a074b3-698c-4ba3-bbc5-b7569d826cc3 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-20a074b3-698c-4ba3-bbc5-b7569d826cc3 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009804 Nov 14 02:25:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 330/986] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 14 02:25:57 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6773753e-cc33-4f4b-a9be-3f10c87322b3 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Action: 'create', calling method: .version_select at 0x7fc9eb0f28c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-748489142", "metadata": {"Type": "work"}}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:25:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6773753e-cc33-4f4b-a9be-3f10c87322b3 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6773753e-cc33-4f4b-a9be-3f10c87322b3 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009668 Nov 14 02:25:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 331/987] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 14 02:25:57 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-66f91dcf-a9bd-4359-965c-3273eb438457 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Calling method '.version_select at 0x7fc9eaf9ca60>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-66f91dcf-a9bd-4359-965c-3273eb438457 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] HTTP exception thrown: Volume tempest-invalid-603681975 could not be found. Nov 14 02:25:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-66f91dcf-a9bd-4359-965c-3273eb438457 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Returning 404 to user: Volume tempest-invalid-603681975 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-66f91dcf-a9bd-4359-965c-3273eb438457 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-603681975" status: 404 len: 98 microversion: 2.1 time: 0.035244 Nov 14 02:25:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 327/988] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 14 02:25:57 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-603681975 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d2f44703-865a-418d-971f-f3eec87f41c0 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003427 Nov 14 02:25:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 331/989] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 14 02:25:57 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7965eed6-483d-4303-81a9-3ad6c2d241f1 tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004470 Nov 14 02:25:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 332/990] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Nov 14 02:25:57 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-18c9b613-9741-4880-aba9-53ee3efc527a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Calling method '.version_select at 0x7fc9eaf43f40>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-18c9b613-9741-4880-aba9-53ee3efc527a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] HTTP exception thrown: Volume c9135c79-34cf-4987-a182-af4e57201a88 could not be found. Nov 14 02:25:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-18c9b613-9741-4880-aba9-53ee3efc527a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Returning 404 to user: Volume c9135c79-34cf-4987-a182-af4e57201a88 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-18c9b613-9741-4880-aba9-53ee3efc527a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c9135c79-34cf-4987-a182-af4e57201a88" status: 404 len: 109 microversion: 2.1 time: 0.031277 Nov 14 02:25:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 328/991] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:25:57 2023] DELETE /compute/v2.1/os-volumes/c9135c79-34cf-4987-a182-af4e57201a88 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:25:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-69cae04e-a616-4836-bc08-0db1e87f8f1a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Calling method '.version_select at 0x7fc9e8658310>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-69cae04e-a616-4836-bc08-0db1e87f8f1a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] HTTP exception thrown: Volume 8297fd9b-1207-4059-9f18-14f4278267fe could not be found. Nov 14 02:25:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-69cae04e-a616-4836-bc08-0db1e87f8f1a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] Returning 404 to user: Volume 8297fd9b-1207-4059-9f18-14f4278267fe could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:25:57 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-69cae04e-a616-4836-bc08-0db1e87f8f1a tempest-VolumesNegativeTest-652202509 tempest-VolumesNegativeTest-652202509-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8297fd9b-1207-4059-9f18-14f4278267fe" status: 404 len: 109 microversion: 2.1 time: 0.032229 Nov 14 02:25:57 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 332/992] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 14 02:25:57 2023] GET /compute/v2.1/os-volumes/8297fd9b-1207-4059-9f18-14f4278267fe => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:25:58 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a805502f5d4186a0ade4f44bd0d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02ec183414b420e8758ffea80902171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:25:58 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ffee811a-79cf-418c-bcc4-25c795ca4709 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1" status: 200 len: 1592 microversion: 2.1 time: 0.242791 Nov 14 02:25:58 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 333/993] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:25:58 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1 => generated 1592 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 could not be found. Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:26:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-cf072f46-0a54-469f-b588-c8bc2bc45a7e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 404 len: 111 microversion: 2.1 time: 0.040302 Nov 14 02:26:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 329/994] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:26:17 2023] GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2050395413", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-905371829"}], "block_device_mapping_v2": [{"uuid": "655abaca-9817-45dd-9bf8-480d3b8aeba8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1177175426", "networks": [{"uuid": "82975375-7a5b-4666-9ca1-d92490943dd9"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-d4459958-b0cb-489d-bded-d1bedf175d04 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053177 Nov 14 02:26:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 334/995] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:26:17 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] HTTP exception thrown: Instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae is not attached to volume 95376504-c9da-4f60-83ad-bbc0fec363ca Nov 14 02:26:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Returning 404 to user: Instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae is not attached to volume 95376504-c9da-4f60-83ad-bbc0fec363ca {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] validate_networks() for [('82975375-7a5b-4666-9ca1-d92490943dd9', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:26:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e1bf3c5f-e3db-43c6-9384-64f71bfbfb64 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca" status: 404 len: 154 microversion: 2.1 time: 0.086980 Nov 14 02:26:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 330/996] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:26:17 2023] DELETE /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae/os-volume_attachments/95376504-c9da-4f60-83ad-bbc0fec363ca => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:26:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='655abaca-9817-45dd-9bf8-480d3b8aeba8',volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:26:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.882026 Nov 14 02:26:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 333/997] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:26:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:26:18 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-edbf1abb-b9ca-42ec-8c69-4c06b2d52d72 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:18 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-edbf1abb-b9ca-42ec-8c69-4c06b2d52d72 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:18 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-edbf1abb-b9ca-42ec-8c69-4c06b2d52d72 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-edbf1abb-b9ca-42ec-8c69-4c06b2d52d72 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" status: 200 len: 1088 microversion: 2.1 time: 0.431447 Nov 14 02:26:18 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 335/998] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:26:18 2023] GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe => generated 1088 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:19 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:26:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae" status: 204 len: 0 microversion: 2.1 time: 0.140265 Nov 14 02:26:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 331/999] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:26:19 2023] DELETE /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4a5d083c42ff8dffe1308cb04d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aa4951950648f3a648099551dbbd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:20 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c87d0dc0-62b9-4186-9f9e-40ab58ebcc0d tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae" status: 200 len: 1698 microversion: 2.1 time: 0.337325 Nov 14 02:26:20 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 334/1000] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:26:19 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae => generated 1698 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2776db-0245-4ee0-ade9-8b87eaa44fae", "name": "network-vif-unplugged", "status": "completed", "tag": "1fecad81-6dfa-495c-97d9-ebbdbb903a58"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Creating event network-vif-unplugged:1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae on user Nov 14 02:26:20 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040193 Nov 14 02:26:20 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 336/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-008eb3f1-18c7-4f05-a7b8-b56d055b3b03 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059426 Nov 14 02:26:20 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 332/1002] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:26:20 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:20 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:26:20 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be" status: 204 len: 0 microversion: 2.1 time: 0.185298 Nov 14 02:26:20 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 335/1003] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:26:20 2023] DELETE /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:21 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-unplugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:21 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:21 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Creating event network-vif-unplugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:26:21 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033115 Nov 14 02:26:21 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 333/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:26:21 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2152cf18-2874-412a-adb7-d2187416767e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be" status: 200 len: 1667 microversion: 2.1 time: 0.483020 Nov 14 02:26:21 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 337/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:26:20 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be => generated 1667 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:26:21 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-ea672a65-57e8-49fb-aa19-15def5503727 req-190ed0de-a488-44f8-ad5e-da2a684e4ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2776db-0245-4ee0-ade9-8b87eaa44fae", "name": "network-vif-deleted", "tag": "1fecad81-6dfa-495c-97d9-ebbdbb903a58"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ea672a65-57e8-49fb-aa19-15def5503727 req-190ed0de-a488-44f8-ad5e-da2a684e4ce6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ea672a65-57e8-49fb-aa19-15def5503727 req-190ed0de-a488-44f8-ad5e-da2a684e4ce6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-ea672a65-57e8-49fb-aa19-15def5503727 req-190ed0de-a488-44f8-ad5e-da2a684e4ce6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-ea672a65-57e8-49fb-aa19-15def5503727 req-190ed0de-a488-44f8-ad5e-da2a684e4ce6 service nova] Creating event network-vif-deleted:1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae on user Nov 14 02:26:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-ea672a65-57e8-49fb-aa19-15def5503727 req-190ed0de-a488-44f8-ad5e-da2a684e4ce6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058809 Nov 14 02:26:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 336/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:22 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2776db-0245-4ee0-ade9-8b87eaa44fae", "name": "network-vif-plugged", "status": "completed", "tag": "1fecad81-6dfa-495c-97d9-ebbdbb903a58"}, {"name": "network-changed", "server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Creating event network-vif-plugged:1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae on user Nov 14 02:26:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Creating event network-changed:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:26:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056598 Nov 14 02:26:22 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 334/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:22 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:26:23 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-plugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}, {"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-plugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}, {"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-plugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}, {"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-unplugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}, {"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-plugged", "status": "completed", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:23 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:23 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Creating event network-vif-plugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:26:23 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Creating event network-vif-plugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:26:23 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Creating event network-vif-plugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:26:23 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Creating event network-vif-unplugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:26:23 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Creating event network-vif-plugged:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:26:23 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034700 Nov 14 02:26:23 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 338/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:23 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:24 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-dde1f339-3be6-4280-8509-64849cb3bd76 req-7972fc2f-c864-4546-8868-87f89439d3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc79fc1-8d23-443f-99b5-2464e115a1be", "name": "network-vif-deleted", "tag": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dde1f339-3be6-4280-8509-64849cb3bd76 req-7972fc2f-c864-4546-8868-87f89439d3d3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dde1f339-3be6-4280-8509-64849cb3bd76 req-7972fc2f-c864-4546-8868-87f89439d3d3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:24 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dde1f339-3be6-4280-8509-64849cb3bd76 req-7972fc2f-c864-4546-8868-87f89439d3d3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-dde1f339-3be6-4280-8509-64849cb3bd76 req-7972fc2f-c864-4546-8868-87f89439d3d3 service nova] Creating event network-vif-deleted:b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be on user Nov 14 02:26:24 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-dde1f339-3be6-4280-8509-64849cb3bd76 req-7972fc2f-c864-4546-8868-87f89439d3d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Nov 14 02:26:24 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 337/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02c3bf99-692c-40d2-92a2-99a680635aad"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:25 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:25 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f1cb58e1-e13c-4102-87ff-4f77eaf5ffdf tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.269031 Nov 14 02:26:25 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 335/1010] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 14 02:26:25 2023] POST /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments => generated 188 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:25 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64867) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 14 02:26:25 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/action" status: 202 len: 0 microversion: 2.20 time: 0.118693 Nov 14 02:26:25 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 339/1011] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:26:25 2023] POST /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:25 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:26 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:26 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:26 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9e4b2dd5-349d-4fac-9c9a-2316c900af1a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 200 len: 1736 microversion: 2.20 time: 0.228169 Nov 14 02:26:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 338/1012] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:26:25 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:26:27 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "name": "network-vif-plugged", "status": "completed", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:27 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Creating event network-vif-plugged:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:26:27 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039360 Nov 14 02:26:27 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 336/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac/action" status: 202 len: 0 microversion: 2.87 time: 0.086584 Nov 14 02:26:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 340/1014] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:26:28 2023] POST /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:29 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:29 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:29 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-71c8b9a5-bb9e-4786-a327-dcaf85d0fd43 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 200 len: 1762 microversion: 2.87 time: 0.238769 Nov 14 02:26:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 339/1015] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:26:28 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 1762 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:26:29 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "name": "network-vif-plugged", "status": "completed", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:29 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Creating event network-vif-plugged:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:26:29 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031939 Nov 14 02:26:29 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 337/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:29 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-unplugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:29 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Creating event network-vif-unplugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:26:29 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038646 Nov 14 02:26:29 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 341/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}, {"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:26:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:26:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114639 Nov 14 02:26:31 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 340/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}, {"name": "network-changed", "server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:26:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Creating event network-changed:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:26:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038433 Nov 14 02:26:33 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 338/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:33 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-548af808-1729-48cb-9e4f-da01dafe9dc0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.164349 Nov 14 02:26:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 342/1020] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:26:40 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-interface => generated 282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:41 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:41 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:41 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Creating event network-changed:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:26:41 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121279 Nov 14 02:26:41 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 341/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:41 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'services' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:26:41 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments/fc412155-c035-4969-aa7f-9e1bc62a4e64" status: 202 len: 0 microversion: 2.1 time: 0.253098 Nov 14 02:26:41 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 339/1022] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:26:41 2023] DELETE /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments/fc412155-c035-4969-aa7f-9e1bc62a4e64 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:41 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:41 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-aac6e258-2bf3-437b-b077-78ae0f9e604a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069909 Nov 14 02:26:41 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 343/1023] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:26:41 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:42 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-plugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:42 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Creating event network-vif-plugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:26:42 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064076 Nov 14 02:26:42 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 342/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Creating event network-changed:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:26:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029753 Nov 14 02:26:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 340/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-plugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Creating event network-vif-plugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:26:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Nov 14 02:26:44 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 344/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c2eecbf7-f402-49f8-a2dc-d166e0e6cac6 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.159983 Nov 14 02:26:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 343/1027] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:26:58 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-interface => generated 283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:59 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:59 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053d9dbc-02cd-49b3-9476-02b32b4cb4a1", "tag": "a2de0a50-a398-4b3b-86a8-86137531ca29"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:26:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Creating event network-changed:a2de0a50-a398-4b3b-86a8-86137531ca29 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 on user Nov 14 02:26:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037315 Nov 14 02:26:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 341/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=12 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:26:59 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a805502f5d4186a0ade4f44bd0d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02ec183414b420e8758ffea80902171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:26:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-36fbac96-c66f-4e7d-8a5f-e60d1a853512 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1" status: 200 len: 1592 microversion: 2.1 time: 0.261696 Nov 14 02:26:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 345/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:26:59 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1 => generated 1592 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b1c6780-6738-4b1e-92c0-6a71a16a1dea"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260259 Nov 14 02:27:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 344/1030] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:27:01 2023] POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:08 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-33bdbacf-c261-4dbf-b92a-5e8873eca06f tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" status: 200 len: 1441 microversion: 2.1 time: 0.223706 Nov 14 02:27:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 342/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:27:08 2023] GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe => generated 1441 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] HTTP exception thrown: Instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae could not be found. Nov 14 02:27:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Returning 404 to user: Instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:27:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ed7400ef-caba-4637-a258-126a17279520 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae" status: 404 len: 111 microversion: 2.1 time: 0.032375 Nov 14 02:27:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 346/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:27:10 2023] GET /compute/v2.1/servers/4d2776db-0245-4ee0-ade9-8b87eaa44fae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:27:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d74cb512-a526-47e8-9aff-a16296fab71e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Calling method '.version_select at 0x7fc9e86324d0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d74cb512-a526-47e8-9aff-a16296fab71e tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580117513" status: 202 len: 0 microversion: 2.1 time: 0.278782 Nov 14 02:27:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 345/1033] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:27:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580117513 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be could not be found. Nov 14 02:27:11 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:27:11 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-40badc7e-db3d-4fa4-905a-afa1c94a08db tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be" status: 404 len: 111 microversion: 2.1 time: 0.029803 Nov 14 02:27:11 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 343/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:27:11 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:27:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-988888fd-092c-4b74-beed-b7924cae6abc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '.version_select at 0x7fc9eaf42560>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-988888fd-092c-4b74-beed-b7924cae6abc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438637596" status: 202 len: 0 microversion: 2.1 time: 0.036574 Nov 14 02:27:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 347/1035] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:27:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438637596 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:27:12 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:12 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ef021bad-35b3-4b1c-9392-8be612f8bab8 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: .version_select at 0x7fc9e865a560>, body: {"keypair": {"name": "tempest-keypair-460841353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJmvdP3IEeHXby/wt82RKAHJ1EuMOuRBONPnvf3oFImlzpnTYz4uBX5pkNhYHtvD+6sZM6d+0uGK7N5zYKnVRA+JfVJ1UjRQy4OBCbppf+/pHfrAvl8b7U9Qdi5muk0UQ=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:12 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ef021bad-35b3-4b1c-9392-8be612f8bab8 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:27:12 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-ef021bad-35b3-4b1c-9392-8be612f8bab8 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:27:12 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ef021bad-35b3-4b1c-9392-8be612f8bab8 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053419 Nov 14 02:27:12 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 346/1036] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:27:12 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:13 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1319516472", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5"}], "security_groups": [{"name": "tempest-securitygroup--1944379214"}], "key_name": "tempest-keypair-460841353", "user_data": "}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:13 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] validate_networks() for [('9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:27:14 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:27:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.900062 Nov 14 02:27:14 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 344/1037] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:27:13 2023] POST /compute/v2.1/servers => generated 400 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:27:14 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-bfefd476-dbe4-49a7-b855-737b743995b3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:14 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-bfefd476-dbe4-49a7-b855-737b743995b3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:14 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-bfefd476-dbe4-49a7-b855-737b743995b3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:14 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-bfefd476-dbe4-49a7-b855-737b743995b3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26" status: 200 len: 1233 microversion: 2.1 time: 0.081657 Nov 14 02:27:14 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 348/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:27:14 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26 => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:15 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'services' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:27:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/2b1c6780-6738-4b1e-92c0-6a71a16a1dea" status: 202 len: 0 microversion: 2.1 time: 0.202667 Nov 14 02:27:15 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 347/1039] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:27:15 2023] DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/2b1c6780-6738-4b1e-92c0-6a71a16a1dea => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-290cc599-3364-45e9-80a8-adbef9b92caf tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049817 Nov 14 02:27:15 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 345/1040] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:27:15 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:16 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:16 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ac1f1d90-7517-43b1-a649-b938185e66e0 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 200 len: 1781 microversion: 2.20 time: 0.291635 Nov 14 02:27:16 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 349/1041] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:27:16 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 1781 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:27:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e80866e-d70f-411d-a38b-78c2d1dbdc26", "tag": "89e73fae-e2e0-4e44-b3cd-633672b01625"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Creating event network-changed:89e73fae-e2e0-4e44-b3cd-633672b01625 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 on user Nov 14 02:27:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040603 Nov 14 02:27:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 348/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:27:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1d489092-bc33-44b4-b742-f37a0ea4f89d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 200 len: 1768 microversion: 2.87 time: 0.204182 Nov 14 02:27:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 346/1043] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:27:19 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 1768 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:27:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e80866e-d70f-411d-a38b-78c2d1dbdc26", "name": "network-vif-plugged", "status": "completed", "tag": "89e73fae-e2e0-4e44-b3cd-633672b01625"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Creating event network-vif-plugged:89e73fae-e2e0-4e44-b3cd-633672b01625 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 on user Nov 14 02:27:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037491 Nov 14 02:27:19 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 350/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:27:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:21 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e80866e-d70f-411d-a38b-78c2d1dbdc26", "name": "network-vif-plugged", "status": "completed", "tag": "89e73fae-e2e0-4e44-b3cd-633672b01625"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Creating event network-vif-plugged:89e73fae-e2e0-4e44-b3cd-633672b01625 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 on user Nov 14 02:27:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043314 Nov 14 02:27:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 349/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:27:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=24 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:32 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-40f3c5e1-fe5f-4c0c-a8e0-ee24652ff9f0 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051723 Nov 14 02:27:32 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 347/1046] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:27:31 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=10 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:32 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:27:32 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 204 len: 0 microversion: 2.1 time: 0.193112 Nov 14 02:27:32 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 351/1047] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:27:32 2023] DELETE /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:32 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:27:32 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-819f143b-b26a-44a5-b6fc-8073098c60e6 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 200 len: 1673 microversion: 2.1 time: 0.359381 Nov 14 02:27:32 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 350/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:27:32 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 1673 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-unplugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:32 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Creating event network-vif-unplugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:27:32 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029585 Nov 14 02:27:32 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 348/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:27:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:34 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-32621113-f81c-4697-8ebe-115902cfea85 req-4f802751-6ab4-49d4-9695-d64ebc69ed75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-deleted", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-32621113-f81c-4697-8ebe-115902cfea85 req-4f802751-6ab4-49d4-9695-d64ebc69ed75 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-32621113-f81c-4697-8ebe-115902cfea85 req-4f802751-6ab4-49d4-9695-d64ebc69ed75 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:34 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-32621113-f81c-4697-8ebe-115902cfea85 req-4f802751-6ab4-49d4-9695-d64ebc69ed75 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-32621113-f81c-4697-8ebe-115902cfea85 req-4f802751-6ab4-49d4-9695-d64ebc69ed75 service nova] Creating event network-vif-deleted:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:27:34 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-32621113-f81c-4697-8ebe-115902cfea85 req-4f802751-6ab4-49d4-9695-d64ebc69ed75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 Nov 14 02:27:34 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 352/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:27:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:27:34 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f49370-77df-4e76-8e1d-4f89580315a4", "name": "network-vif-plugged", "status": "completed", "tag": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:27:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:27:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:27:34 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:27:34 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Creating event network-vif-plugged:cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 on user Nov 14 02:27:34 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257298 Nov 14 02:27:34 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 351/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:27:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:04 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:28:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-635941e9-f980-41d3-aae6-a6589f13c727 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26" status: 200 len: 1543 microversion: 2.1 time: 0.213909 Nov 14 02:28:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 349/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:28:04 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26 => generated 1543 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-98a77535-f337-44df-8057-1801044702d2 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056606 Nov 14 02:28:05 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 353/1053] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:28:05 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=8 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a9fe585-47e9-453c-9851-1a3220ad21f0"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281434 Nov 14 02:28:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 352/1054] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:28:07 2023] POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:09 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:28:09 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c6e3451b-6032-4fdd-b7df-33f88ba541fe tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" status: 200 len: 1441 microversion: 2.1 time: 0.203727 Nov 14 02:28:09 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 350/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:28:08 2023] GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe => generated 1441 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:28:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Creating event network-changed:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:28:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032380 Nov 14 02:28:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 354/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:13 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-135866589", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-905371829"}], "block_device_mapping_v2": [{"uuid": "e28eaf8b-a06c-48e1-8242-dd6329cff46c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1177175426", "networks": [{"uuid": "82975375-7a5b-4666-9ca1-d92490943dd9"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:13 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] validate_networks() for [('82975375-7a5b-4666-9ca1-d92490943dd9', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting quotas for user 61052c8663184644aa445e8b29a9d6ed and project 6e49d1cf0a1c457ab943ffd360f1c3da. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:28:14 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e28eaf8b-a06c-48e1-8242-dd6329cff46c',volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:28:14 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.117197 Nov 14 02:28:14 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 353/1057] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:28:13 2023] POST /compute/v2.1/servers => generated 403 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:28:14 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-17dbd0ff-cae0-4931-b942-61e9d6394cf0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:14 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-17dbd0ff-cae0-4931-b942-61e9d6394cf0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:14 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-17dbd0ff-cae0-4931-b942-61e9d6394cf0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:28:14 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-17dbd0ff-cae0-4931-b942-61e9d6394cf0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af" status: 200 len: 1087 microversion: 2.1 time: 0.066889 Nov 14 02:28:14 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 351/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:28:14 2023] GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:15 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'services' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:28:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/1a9fe585-47e9-453c-9851-1a3220ad21f0" status: 202 len: 0 microversion: 2.1 time: 0.173427 Nov 14 02:28:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 355/1059] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:28:15 2023] DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/1a9fe585-47e9-453c-9851-1a3220ad21f0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-397de0fd-fd16-476b-b39a-6584331c5530 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049470 Nov 14 02:28:15 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 354/1060] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:28:15 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:16 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:16 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-11b19611-7af3-441c-9fdb-188514908c15 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments/02c3bf99-692c-40d2-92a2-99a680635aad" status: 200 len: 194 microversion: 2.20 time: 0.172092 Nov 14 02:28:16 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 352/1061] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Nov 14 02:28:16 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments/02c3bf99-692c-40d2-92a2-99a680635aad => generated 194 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:17 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'services' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:28:17 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments/02c3bf99-692c-40d2-92a2-99a680635aad" status: 202 len: 0 microversion: 2.20 time: 0.176249 Nov 14 02:28:17 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 356/1062] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 14 02:28:17 2023] DELETE /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments/02c3bf99-692c-40d2-92a2-99a680635aad => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:17 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a2464751-4669-4baa-902e-a84eb58bf7ca tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056483 Nov 14 02:28:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 355/1063] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 14 02:28:17 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 14 02:28:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Creating event network-changed:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:28:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105020 Nov 14 02:28:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 353/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:19 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:28:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 204 len: 0 microversion: 2.87 time: 0.218941 Nov 14 02:28:19 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 357/1065] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:28:19 2023] DELETE /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-unplugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:28:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Creating event network-vif-unplugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:28:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041657 Nov 14 02:28:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 354/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:28:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:28:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ef88a1d4-fbf3-423f-bcce-b4c573474c9d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 200 len: 1774 microversion: 2.87 time: 0.303411 Nov 14 02:28:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 356/1067] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:28:19 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 1774 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:28:21 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-plugged", "status": "completed", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}, {"server_uuid": "cbecb74e-b1af-404a-9fd6-050328413cac", "name": "network-vif-deleted", "tag": "109d45a8-89e1-43d8-9134-d29c37330e20"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:21 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:22 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:22 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Creating event network-vif-plugged:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:28:22 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Creating event network-vif-deleted:109d45a8-89e1-43d8-9134-d29c37330e20 for instance cbecb74e-b1af-404a-9fd6-050328413cac on user Nov 14 02:28:22 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044478 Nov 14 02:28:22 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 358/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] HTTP exception thrown: Instance 14f49370-77df-4e76-8e1d-4f89580315a4 could not be found. Nov 14 02:28:22 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Returning 404 to user: Instance 14f49370-77df-4e76-8e1d-4f89580315a4 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:28:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f067029f-16a5-4a30-b647-753715c5bcf3 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4" status: 404 len: 111 microversion: 2.1 time: 0.031417 Nov 14 02:28:22 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 355/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:28:22 2023] GET /compute/v2.1/servers/14f49370-77df-4e76-8e1d-4f89580315a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:28:22 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ba7b6f4a-b597-438f-b58e-f8bbf06b6674 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '.version_select at 0x7fc9eafb70a0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:22 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ba7b6f4a-b597-438f-b58e-f8bbf06b6674 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-34722916" status: 202 len: 0 microversion: 2.1 time: 0.050165 Nov 14 02:28:22 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 357/1070] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 14 02:28:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-34722916 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:28:24 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "name": "network-vif-plugged", "status": "completed", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:24 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:24 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Creating event network-vif-plugged:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:28:24 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036254 Nov 14 02:28:24 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 359/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "name": "network-vif-plugged", "status": "completed", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:26 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Creating event network-vif-plugged:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:28:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033923 Nov 14 02:28:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 356/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:28:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e" status: 204 len: 0 microversion: 2.1 time: 0.135866 Nov 14 02:28:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 358/1073] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:28:28 2023] DELETE /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-unplugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:28 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:28:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:28 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-911254d0-8b5f-4ffe-9861-aaf3e1d0b9d9 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e" status: 200 len: 1494 microversion: 2.1 time: 0.238133 Nov 14 02:28:28 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:28 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 360/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:28:28 2023] GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e => generated 1494 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:28:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Creating event network-vif-unplugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:28:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037786 Nov 14 02:28:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 357/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:29 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-deleted", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:29 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] Creating event network-vif-deleted:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:28:29 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Nov 14 02:28:29 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 359/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:28:30 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5782b-9a73-4309-a559-4a81d3c5ce2e", "name": "network-vif-plugged", "status": "completed", "tag": "38baa7d3-e79c-48c0-a478-d946f09f9787"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:28:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:28:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:28:30 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:28:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Creating event network-vif-plugged:38baa7d3-e79c-48c0-a478-d946f09f9787 for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e on user Nov 14 02:28:30 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034179 Nov 14 02:28:30 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 361/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:28:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=20 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=28 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:04 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:04 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-edc462c4-4381-432f-9cc2-dcddafe5a388 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af" status: 200 len: 1439 microversion: 2.1 time: 0.227883 Nov 14 02:29:04 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 358/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:29:04 2023] GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af => generated 1439 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:04 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:05 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-65749ac1-c73f-49a5-8f9f-27ce3af621e9 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.152848 Nov 14 02:29:05 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 360/1079] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:29:04 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-interface => generated 283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-055bd57c-a59b-4c07-b387-0bbfaff8cf60 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060180 Nov 14 02:29:05 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 362/1080] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:29:05 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:29:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e80866e-d70f-411d-a38b-78c2d1dbdc26", "tag": "89e73fae-e2e0-4e44-b3cd-633672b01625"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Creating event network-changed:89e73fae-e2e0-4e44-b3cd-633672b01625 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 on user Nov 14 02:29:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031964 Nov 14 02:29:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 359/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-6c76b939-e48b-4c6e-b176-01d015391dc3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/ips" status: 200 len: 108 microversion: 2.1 time: 0.044083 Nov 14 02:29:06 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 361/1082] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:29:06 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/ips => generated 108 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-89056ac9-e088-405a-9b77-377005252633 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045291 Nov 14 02:29:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 363/1083] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 14 02:29:07 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a46da4-16d6-477b-bec4-7e0cb6b6d792"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 204 len: 0 microversion: 2.20 time: 0.116438 Nov 14 02:29:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 360/1084] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:29:07 2023] DELETE /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cf1b41c-f8ef-41ba-8525-8bb005e04658"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-8c7b68d8-465c-4e54-b716-a3bf4800d580 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 200 len: 1709 microversion: 2.20 time: 0.237486 Nov 14 02:29:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 364/1085] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:29:07 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 1709 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:29:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338823 Nov 14 02:29:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 362/1086] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:29:07 2023] POST /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-unplugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Creating event network-vif-unplugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:29:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043669 Nov 14 02:29:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 365/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328469 Nov 14 02:29:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 361/1088] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:29:07 2023] POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:29:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0621685b-500d-46e2-aa76-4468dd33ce6b req-eb8c5a98-224c-4004-9a71-ba7e24f0b0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-deleted", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0621685b-500d-46e2-aa76-4468dd33ce6b req-eb8c5a98-224c-4004-9a71-ba7e24f0b0fd service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0621685b-500d-46e2-aa76-4468dd33ce6b req-eb8c5a98-224c-4004-9a71-ba7e24f0b0fd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0621685b-500d-46e2-aa76-4468dd33ce6b req-eb8c5a98-224c-4004-9a71-ba7e24f0b0fd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0621685b-500d-46e2-aa76-4468dd33ce6b req-eb8c5a98-224c-4004-9a71-ba7e24f0b0fd service nova] Creating event network-vif-deleted:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:29:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0621685b-500d-46e2-aa76-4468dd33ce6b req-eb8c5a98-224c-4004-9a71-ba7e24f0b0fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033334 Nov 14 02:29:09 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 363/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:09 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc", "name": "network-vif-plugged", "status": "completed", "tag": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:09 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Creating event network-vif-plugged:cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc on user Nov 14 02:29:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027995 Nov 14 02:29:09 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 366/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HTTP exception thrown: Instance cbecb74e-b1af-404a-9fd6-050328413cac could not be found. Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Returning 404 to user: Instance cbecb74e-b1af-404a-9fd6-050328413cac could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:29:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1b73b73f-1077-4f1c-8f7c-44c7b4e63d88 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac" status: 404 len: 111 microversion: 2.87 time: 0.029536 Nov 14 02:29:10 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 362/1091] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:29:10 2023] GET /compute/v2.1/servers/cbecb74e-b1af-404a-9fd6-050328413cac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:29:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b" status: 204 len: 0 microversion: 2.87 time: 0.113881 Nov 14 02:29:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 364/1092] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:29:10 2023] DELETE /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9ecc12-fe4e-4124-8f4c-2160cd08337b", "name": "network-vif-unplugged", "status": "completed", "tag": "9f182a18-791f-4fba-b4b9-787664194dd7"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:10 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:10 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Creating event network-vif-unplugged:9f182a18-791f-4fba-b4b9-787664194dd7 for instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b on user Nov 14 02:29:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-da8819cd-1d87-4c88-bf95-05ba8d4347c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b" status: 200 len: 1697 microversion: 2.87 time: 0.334881 Nov 14 02:29:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 367/1093] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:29:10 2023] GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b => generated 1697 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:29:10 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054679 Nov 14 02:29:10 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 363/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9ecc12-fe4e-4124-8f4c-2160cd08337b", "name": "network-vif-deleted", "tag": "9f182a18-791f-4fba-b4b9-787664194dd7"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] Creating event network-vif-deleted:9f182a18-791f-4fba-b4b9-787664194dd7 for instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b on user Nov 14 02:29:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033717 Nov 14 02:29:11 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 365/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:12 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9ecc12-fe4e-4124-8f4c-2160cd08337b", "name": "network-vif-plugged", "status": "completed", "tag": "9f182a18-791f-4fba-b4b9-787664194dd7"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:12 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Creating event network-vif-plugged:9f182a18-791f-4fba-b4b9-787664194dd7 for instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b on user Nov 14 02:29:12 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038844 Nov 14 02:29:12 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 368/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a46da4-16d6-477b-bec4-7e0cb6b6d792"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Invalid volume: volume e4a46da4-16d6-477b-bec4-7e0cb6b6d792 is already attached to instances: 0e80866e-d70f-411d-a38b-78c2d1dbdc26 Nov 14 02:29:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 400 to user: Invalid volume: volume e4a46da4-16d6-477b-bec4-7e0cb6b6d792 is already attached to instances: 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:29:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-346828e1-3147-4443-b4fc-c4a9083f8458 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100723 Nov 14 02:29:15 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 364/1097] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:29:15 2023] POST /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:15 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'services' on Instance uuid 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:29:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments/e4a46da4-16d6-477b-bec4-7e0cb6b6d792" status: 202 len: 0 microversion: 2.1 time: 0.196474 Nov 14 02:29:15 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 366/1098] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:29:15 2023] DELETE /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments/e4a46da4-16d6-477b-bec4-7e0cb6b6d792 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-53670a58-dbee-4676-9c06-8f20144fde1a tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050305 Nov 14 02:29:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 369/1099] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:29:15 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:17 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'services' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:29:18 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/4cf1b41c-f8ef-41ba-8525-8bb005e04658" status: 202 len: 0 microversion: 2.1 time: 0.154921 Nov 14 02:29:18 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 365/1100] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:29:17 2023] DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/4cf1b41c-f8ef-41ba-8525-8bb005e04658 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:18 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-48bc3ca6-8915-424b-9f65-ccf2ff18caaa tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048995 Nov 14 02:29:18 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 367/1101] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:29:18 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] HTTP exception thrown: Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e could not be found. Nov 14 02:29:18 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Returning 404 to user: Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:29:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f682c309-5f91-457b-9919-ff73217af2cd tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e" status: 404 len: 111 microversion: 2.1 time: 0.173208 Nov 14 02:29:18 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 370/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:29:18 2023] GET /compute/v2.1/servers/aef5782b-9a73-4309-a559-4a81d3c5ce2e => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:18 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:29:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 204 len: 0 microversion: 2.1 time: 0.113955 Nov 14 02:29:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 366/1103] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:29:18 2023] DELETE /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:19 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:29:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-cd068950-1ba5-4a06-8d58-65bf79e634a8 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 200 len: 1508 microversion: 2.1 time: 0.317078 Nov 14 02:29:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:29:19 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:29:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-unplugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Creating event network-vif-unplugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:29:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030529 Nov 14 02:29:19 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 371/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:20 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-da3b11f1-a590-4ec0-9d37-9a569b7d87c8 req-da4f516c-d5c8-4073-8b24-e4ef40f77646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-deleted", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-da3b11f1-a590-4ec0-9d37-9a569b7d87c8 req-da4f516c-d5c8-4073-8b24-e4ef40f77646 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-da3b11f1-a590-4ec0-9d37-9a569b7d87c8 req-da4f516c-d5c8-4073-8b24-e4ef40f77646 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-da3b11f1-a590-4ec0-9d37-9a569b7d87c8 req-da4f516c-d5c8-4073-8b24-e4ef40f77646 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-da3b11f1-a590-4ec0-9d37-9a569b7d87c8 req-da4f516c-d5c8-4073-8b24-e4ef40f77646 service nova] Creating event network-vif-deleted:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:29:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-da3b11f1-a590-4ec0-9d37-9a569b7d87c8 req-da4f516c-d5c8-4073-8b24-e4ef40f77646 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036468 Nov 14 02:29:20 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 367/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:29:21 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef", "name": "network-vif-plugged", "status": "completed", "tag": "775872ee-1599-4358-9d11-07252d3855ce"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Creating event network-vif-plugged:775872ee-1599-4358-9d11-07252d3855ce for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef on user Nov 14 02:29:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035090 Nov 14 02:29:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 369/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:29:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=22 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=40 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:29:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] HTTP exception thrown: Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc could not be found. Nov 14 02:29:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Returning 404 to user: Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:29:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5bd01a62-786a-4997-94b0-81d8c6c302cc tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 404 len: 111 microversion: 2.20 time: 0.038012 Nov 14 02:29:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 372/1108] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:29:57 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:29:57 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:57 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:57 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-9e4dcbac-413c-4baa-9051-b14e575bd9a3 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '.version_select at 0x7fc9eaf9fa30>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:29:57 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-9e4dcbac-413c-4baa-9051-b14e575bd9a3 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542235845" status: 204 len: 0 microversion: 2.20 time: 0.032395 Nov 14 02:29:57 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 368/1109] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 14 02:29:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542235845 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:29:58 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:58 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:29:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-9f9b896d-d1ff-4cd1-82cc-348dbf975216 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'create', calling method: .version_select at 0x7fc9e865a5f0>, body: {"keypair": {"name": "tempest-keypair-1707904333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE91lh5tHRqpYXNObplNRCy+a795EP7uZgnVuDAfVsDnERaiLFlI1bE+Gi73FXjtQk5G/hWsJT6013+Zi2k8RWa470GvxW1pXuyWjGkKEApcXI2Ty4VUOS+0NMGPshoXyg=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:29:58 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-9f9b896d-d1ff-4cd1-82cc-348dbf975216 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:29:58 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-9f9b896d-d1ff-4cd1-82cc-348dbf975216 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for user d50e0e5a436243f2a91c012a4996185c and project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:29:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-9f9b896d-d1ff-4cd1-82cc-348dbf975216 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.064940 Nov 14 02:29:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 370/1110] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 14 02:29:58 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 14 02:29:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1660326635", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e09cacfd-7877-4055-bd31-ae7e6d56d272"}], "security_groups": [{"name": "tempest-securitygroup--1652412697"}], "key_name": "tempest-keypair-1707904333", "user_data": "}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] validate_networks() for [('e09cacfd-7877-4055-bd31-ae7e6d56d272', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting quotas for user d50e0e5a436243f2a91c012a4996185c and project 4c246fb95dcc49fd910ec526b1977fc8. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:30:00 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.593875 Nov 14 02:30:00 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 373/1111] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 14 02:29:59 2023] POST /compute/v2.1/servers => generated 400 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 14 02:30:00 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d2e8fae9-a91c-4607-b426-69e030c64380 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:00 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d2e8fae9-a91c-4607-b426-69e030c64380 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:00 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-d2e8fae9-a91c-4607-b426-69e030c64380 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:00 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-d2e8fae9-a91c-4607-b426-69e030c64380 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:00 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-d2e8fae9-a91c-4607-b426-69e030c64380 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d2e8fae9-a91c-4607-b426-69e030c64380 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 200 len: 1274 microversion: 2.20 time: 0.070720 Nov 14 02:30:00 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 369/1112] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:30:00 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 1274 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:00 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HTTP exception thrown: Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b could not be found. Nov 14 02:30:00 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Returning 404 to user: Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:30:00 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0c434af1-16be-4c7e-b277-12d310d76b83 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b" status: 404 len: 111 microversion: 2.87 time: 0.032120 Nov 14 02:30:00 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 371/1113] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:30:00 2023] GET /compute/v2.1/servers/ba9ecc12-fe4e-4124-8f4c-2160cd08337b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:00 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:30:01 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 204 len: 0 microversion: 2.87 time: 0.115564 Nov 14 02:30:01 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 374/1114] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:30:00 2023] DELETE /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-unplugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Creating event network-vif-unplugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:30:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032651 Nov 14 02:30:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 372/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:01 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:01 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-64d2f50f-eb8e-4bd0-a174-d706ed27fb11 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 200 len: 1774 microversion: 2.87 time: 0.242371 Nov 14 02:30:01 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 370/1116] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:30:01 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 1774 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:30:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-deleted", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] Creating event network-vif-deleted:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:30:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042053 Nov 14 02:30:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 375/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Creating event network-changed:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:30:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029369 Nov 14 02:30:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 373/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:03 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab639b27-9978-41c7-b93d-e18bd4af09d7", "name": "network-vif-plugged", "status": "completed", "tag": "88e98b9f-7f03-4af9-a6a6-e512673f84ae"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:03 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Creating event network-vif-plugged:88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance ab639b27-9978-41c7-b93d-e18bd4af09d7 on user Nov 14 02:30:03 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Nov 14 02:30:03 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 371/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-plugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:04 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:04 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Creating event network-vif-plugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:30:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043065 Nov 14 02:30:05 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 376/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:05 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:05 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:05 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-e85872b4-6c61-414b-b337-baf8bd0d80a0 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af" status: 200 len: 1439 microversion: 2.1 time: 0.292471 Nov 14 02:30:05 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 374/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:30:04 2023] GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af => generated 1439 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6186ab24-892b-4d6b-add6-02f20ac4e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047641 Nov 14 02:30:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 372/1122] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:30:05 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:06 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:30:06 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26" status: 204 len: 0 microversion: 2.1 time: 0.107185 Nov 14 02:30:06 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 377/1123] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:30:05 2023] DELETE /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:06 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-764c5e55-c8af-402b-9a81-7861b418bd3b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26" status: 200 len: 1667 microversion: 2.1 time: 0.275120 Nov 14 02:30:06 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 375/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:30:06 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26 => generated 1667 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:30:06 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e80866e-d70f-411d-a38b-78c2d1dbdc26", "name": "network-vif-unplugged", "status": "completed", "tag": "89e73fae-e2e0-4e44-b3cd-633672b01625"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Creating event network-vif-unplugged:89e73fae-e2e0-4e44-b3cd-633672b01625 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 on user Nov 14 02:30:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029685 Nov 14 02:30:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 373/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-plugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Creating event network-vif-plugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:30:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052080 Nov 14 02:30:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 378/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Creating event network-changed:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:30:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030864 Nov 14 02:30:08 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:30:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 379/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-1b75ef36-9fdc-4f04-9d31-d1c500bf8f89 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.186180 Nov 14 02:30:08 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 376/1128] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:30:08 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 25 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:30:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af" status: 204 len: 0 microversion: 2.1 time: 0.130620 Nov 14 02:30:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 374/1129] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:30:08 2023] DELETE /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e80866e-d70f-411d-a38b-78c2d1dbdc26", "name": "network-vif-plugged", "status": "completed", "tag": "89e73fae-e2e0-4e44-b3cd-633672b01625"}, {"name": "network-changed", "server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}, {"server_uuid": "0e80866e-d70f-411d-a38b-78c2d1dbdc26", "name": "network-vif-deleted", "tag": "89e73fae-e2e0-4e44-b3cd-633672b01625"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:08 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Creating event network-vif-plugged:89e73fae-e2e0-4e44-b3cd-633672b01625 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 on user Nov 14 02:30:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Creating event network-changed:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:30:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Creating event network-vif-deleted:89e73fae-e2e0-4e44-b3cd-633672b01625 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 on user Nov 14 02:30:08 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.069165 Nov 14 02:30:08 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 377/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:08 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:08 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:08 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-30dc9f83-f831-4cf7-8d92-a7b9f97faa26 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af" status: 200 len: 1445 microversion: 2.1 time: 0.293683 Nov 14 02:30:08 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 380/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:30:08 2023] GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af => generated 1445 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:09 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] HTTP exception thrown: Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef could not be found. Nov 14 02:30:09 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Returning 404 to user: Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:30:09 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5daa3e48-ed54-424d-beed-dc596be9b909 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" status: 404 len: 111 microversion: 2.1 time: 0.029723 Nov 14 02:30:09 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 375/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:30:09 2023] GET /compute/v2.1/servers/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98f3b222-e2d4-4f42-a1f1-e450ac6d8713"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350399 Nov 14 02:30:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 378/1133] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:30:10 2023] POST /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:30:10 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "name": "network-vif-unplugged", "status": "completed", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}, {"server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "name": "network-vif-plugged", "status": "completed", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}, {"server_uuid": "b3976d80-daaa-4826-aeae-6178073670af", "name": "network-vif-deleted", "tag": "bcd7a893-39ad-407d-84fb-0587f21fe9bc"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:10 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:10 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:10 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Creating event network-vif-unplugged:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:30:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Creating event network-vif-plugged:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:30:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Creating event network-vif-deleted:bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance b3976d80-daaa-4826-aeae-6178073670af on user Nov 14 02:30:10 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.045786 Nov 14 02:30:10 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 381/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:10 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:19 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'services' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:30:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/98f3b222-e2d4-4f42-a1f1-e450ac6d8713" status: 202 len: 0 microversion: 2.1 time: 0.168622 Nov 14 02:30:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 376/1135] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:30:19 2023] DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments/98f3b222-e2d4-4f42-a1f1-e450ac6d8713 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-395816a2-1da6-481c-a3c6-59c7f6d946f1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Nov 14 02:30:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 379/1136] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:30:19 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:50 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:30:50 user devstack@n-api.service[64867]: Tue Nov 14 02:30:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 (ip 10.0.0.210) !!! Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c64003c2-e164-4205-bb51-84a6372cd3c8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 200 len: 1587 microversion: 2.20 time: 0.342738 Nov 14 02:30:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 382/1137] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:30:50 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 1587 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HTTP exception thrown: Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 could not be found. Nov 14 02:30:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Returning 404 to user: Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:30:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-227ce527-e7a6-4924-8206-ce20136ae9fe tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7" status: 404 len: 111 microversion: 2.87 time: 0.036989 Nov 14 02:30:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 377/1138] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:30:51 2023] GET /compute/v2.1/servers/ab639b27-9978-41c7-b93d-e18bd4af09d7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:51 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:30:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a" status: 204 len: 0 microversion: 2.87 time: 0.123933 Nov 14 02:30:51 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 380/1139] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:30:51 2023] DELETE /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:52 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:52 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:52 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cdcf9f-848c-4960-87ca-3a8afa145b6a", "name": "network-vif-unplugged", "status": "completed", "tag": "c975f85e-f764-4db8-a9e1-e07ca13ce937"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-80f0eef2-49ff-4dd1-b006-ab59e9f50d2f tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a" status: 200 len: 1696 microversion: 2.87 time: 0.300195 Nov 14 02:30:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 383/1140] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:30:51 2023] GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a => generated 1696 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:30:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Creating event network-vif-unplugged:c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a on user Nov 14 02:30:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027692 Nov 14 02:30:52 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 378/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-b9bbf3cf-5946-4ca8-907f-2db7ebf0a031 req-d0d199bc-18c1-40e6-bd9d-922059562c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cdcf9f-848c-4960-87ca-3a8afa145b6a", "name": "network-vif-deleted", "tag": "c975f85e-f764-4db8-a9e1-e07ca13ce937"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b9bbf3cf-5946-4ca8-907f-2db7ebf0a031 req-d0d199bc-18c1-40e6-bd9d-922059562c7b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b9bbf3cf-5946-4ca8-907f-2db7ebf0a031 req-d0d199bc-18c1-40e6-bd9d-922059562c7b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b9bbf3cf-5946-4ca8-907f-2db7ebf0a031 req-d0d199bc-18c1-40e6-bd9d-922059562c7b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-b9bbf3cf-5946-4ca8-907f-2db7ebf0a031 req-d0d199bc-18c1-40e6-bd9d-922059562c7b service nova] Creating event network-vif-deleted:c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a on user Nov 14 02:30:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-b9bbf3cf-5946-4ca8-907f-2db7ebf0a031 req-d0d199bc-18c1-40e6-bd9d-922059562c7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031243 Nov 14 02:30:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 381/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cdcf9f-848c-4960-87ca-3a8afa145b6a", "name": "network-vif-plugged", "status": "completed", "tag": "c975f85e-f764-4db8-a9e1-e07ca13ce937"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Creating event network-vif-plugged:c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a on user Nov 14 02:30:54 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028415 Nov 14 02:30:54 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 384/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:30:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:56 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 could not be found. Nov 14 02:30:56 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:30:56 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a405413f-8a74-4ec5-86df-960dbe62d7c2 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26" status: 404 len: 111 microversion: 2.1 time: 0.156802 Nov 14 02:30:56 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 379/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:30:56 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:30:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-fb19eedf-7c21-4003-bf53-ac627a2a02fb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '.version_select at 0x7fc9eb551120>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-fb19eedf-7c21-4003-bf53-ac627a2a02fb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460841353" status: 202 len: 0 microversion: 2.1 time: 0.023057 Nov 14 02:30:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 382/1145] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 14 02:30:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460841353 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:30:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-49d748c1-8131-4fea-bc14-2d42ee4193fb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: .version_select at 0x7fc9eafbb640>, body: {"keypair": {"name": "tempest-keypair-1397251301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN9PjizNz0gpkXqMDx7Aam/2OHp12RcXO1B+SaHkWDuPSJrV1I64ohotW51JDJtQMCceW+wmax80U/6Ip8wb5G0n7gKn5R0gpXf+R8lN4eQFwUCIImWxRBXr9x/I1/FEw=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:57 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-49d748c1-8131-4fea-bc14-2d42ee4193fb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:30:57 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-49d748c1-8131-4fea-bc14-2d42ee4193fb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:30:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-49d748c1-8131-4fea-bc14-2d42ee4193fb tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066232 Nov 14 02:30:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 385/1146] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:30:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:30:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-724865243", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5"}], "security_groups": [{"name": "tempest-securitygroup--1137384232"}], "key_name": "tempest-keypair-1397251301", "user_data": "}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance b3976d80-daaa-4826-aeae-6178073670af could not be found. Nov 14 02:30:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance b3976d80-daaa-4826-aeae-6178073670af could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:30:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-659fc3a3-2555-40c2-a0ee-2798c165e95e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af" status: 404 len: 111 microversion: 2.1 time: 0.185056 Nov 14 02:30:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 383/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:30:58 2023] GET /compute/v2.1/servers/b3976d80-daaa-4826-aeae-6178073670af => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:30:58 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] validate_networks() for [('9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting quotas for user ca8f18684c914e9f93d16df39763743e and project bb0268a9065e45f5978c20365956e369. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:30:59 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:30:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.800227 Nov 14 02:30:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 380/1148] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:30:58 2023] POST /compute/v2.1/servers => generated 400 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:30:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7f9e76e1-cbd7-46e0-9943-1fc9d5bf67f1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:30:59 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7f9e76e1-cbd7-46e0-9943-1fc9d5bf67f1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:30:59 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-7f9e76e1-cbd7-46e0-9943-1fc9d5bf67f1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:30:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7f9e76e1-cbd7-46e0-9943-1fc9d5bf67f1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169" status: 200 len: 1233 microversion: 2.1 time: 0.130983 Nov 14 02:30:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 386/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:30:59 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169 => generated 1233 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:31:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcfd6b0-46e9-4194-b83c-dbd004cb5169", "tag": "18760f94-6e18-4d6a-8934-5bb624700993"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Creating event network-changed:18760f94-6e18-4d6a-8934-5bb624700993 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 on user Nov 14 02:31:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033907 Nov 14 02:31:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 384/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:02 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:02 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Creating event network-changed:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:31:02 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031517 Nov 14 02:31:02 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 387/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:02 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:31:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" status: 204 len: 0 microversion: 2.1 time: 0.127219 Nov 14 02:31:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 381/1152] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:31:02 2023] DELETE /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "name": "network-vif-unplugged", "status": "completed", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Creating event network-vif-unplugged:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:31:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029736 Nov 14 02:31:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 388/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:03 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:31:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-db35657b-b79c-4dde-bddc-4324a647fbcd tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" status: 200 len: 1565 microversion: 2.1 time: 0.418540 Nov 14 02:31:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 385/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:31:02 2023] GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe => generated 1565 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:31:04 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-75816713-8eac-42d5-a45c-f0a485ef576e req-34d02600-0e16-4dfb-ad29-775155faef11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "name": "network-vif-deleted", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-75816713-8eac-42d5-a45c-f0a485ef576e req-34d02600-0e16-4dfb-ad29-775155faef11 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-75816713-8eac-42d5-a45c-f0a485ef576e req-34d02600-0e16-4dfb-ad29-775155faef11 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:04 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-75816713-8eac-42d5-a45c-f0a485ef576e req-34d02600-0e16-4dfb-ad29-775155faef11 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-75816713-8eac-42d5-a45c-f0a485ef576e req-34d02600-0e16-4dfb-ad29-775155faef11 service nova] Creating event network-vif-deleted:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:31:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-75816713-8eac-42d5-a45c-f0a485ef576e req-34d02600-0e16-4dfb-ad29-775155faef11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028148 Nov 14 02:31:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 382/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe", "name": "network-vif-plugged", "status": "completed", "tag": "f2ab062e-af46-4816-8393-d3632a9607bd"}, {"server_uuid": "9fcfd6b0-46e9-4194-b83c-dbd004cb5169", "name": "network-vif-plugged", "status": "completed", "tag": "18760f94-6e18-4d6a-8934-5bb624700993"}, {"server_uuid": "9fcfd6b0-46e9-4194-b83c-dbd004cb5169", "name": "network-vif-plugged", "status": "completed", "tag": "18760f94-6e18-4d6a-8934-5bb624700993"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Creating event network-vif-plugged:f2ab062e-af46-4816-8393-d3632a9607bd for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe on user Nov 14 02:31:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Creating event network-vif-plugged:18760f94-6e18-4d6a-8934-5bb624700993 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 on user Nov 14 02:31:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Creating event network-vif-plugged:18760f94-6e18-4d6a-8934-5bb624700993 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 on user Nov 14 02:31:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035274 Nov 14 02:31:05 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 389/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:09 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:09 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-dce94150-2220-492f-930c-ae80e92a6f8c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043922 Nov 14 02:31:09 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 386/1157] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:31:09 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:20 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Going to try to terminate instance {{(pid=64866) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:31:20 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1" status: 204 len: 0 microversion: 2.1 time: 0.178861 Nov 14 02:31:20 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 383/1158] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:31:20 2023] DELETE /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=20 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:20 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:21 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053d9dbc-02cd-49b3-9476-02b32b4cb4a1", "name": "network-vif-unplugged", "status": "completed", "tag": "a2de0a50-a398-4b3b-86a8-86137531ca29"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:21 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:21 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Creating event network-vif-unplugged:a2de0a50-a398-4b3b-86a8-86137531ca29 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 on user Nov 14 02:31:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040260 Nov 14 02:31:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 387/1159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:21 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a805502f5d4186a0ade4f44bd0d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02ec183414b420e8758ffea80902171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:31:21 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a48741ba-f738-467f-9e80-8974d69899ea tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1" status: 200 len: 1716 microversion: 2.1 time: 0.515728 Nov 14 02:31:21 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 390/1160] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:31:20 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1 => generated 1716 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:31:22 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-121e045b-d023-4df8-b47e-16fae64d8462 req-36d5dd1b-6968-42b6-9731-8ecd19084d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053d9dbc-02cd-49b3-9476-02b32b4cb4a1", "name": "network-vif-deleted", "tag": "a2de0a50-a398-4b3b-86a8-86137531ca29"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-121e045b-d023-4df8-b47e-16fae64d8462 req-36d5dd1b-6968-42b6-9731-8ecd19084d62 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-121e045b-d023-4df8-b47e-16fae64d8462 req-36d5dd1b-6968-42b6-9731-8ecd19084d62 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:22 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-121e045b-d023-4df8-b47e-16fae64d8462 req-36d5dd1b-6968-42b6-9731-8ecd19084d62 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-121e045b-d023-4df8-b47e-16fae64d8462 req-36d5dd1b-6968-42b6-9731-8ecd19084d62 service nova] Creating event network-vif-deleted:a2de0a50-a398-4b3b-86a8-86137531ca29 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 on user Nov 14 02:31:22 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-121e045b-d023-4df8-b47e-16fae64d8462 req-36d5dd1b-6968-42b6-9731-8ecd19084d62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033202 Nov 14 02:31:22 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 384/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:23 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053d9dbc-02cd-49b3-9476-02b32b4cb4a1", "name": "network-vif-plugged", "status": "completed", "tag": "a2de0a50-a398-4b3b-86a8-86137531ca29"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:23 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:23 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Creating event network-vif-plugged:a2de0a50-a398-4b3b-86a8-86137531ca29 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 on user Nov 14 02:31:23 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029707 Nov 14 02:31:23 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 388/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HTTP exception thrown: Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a could not be found. Nov 14 02:31:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Returning 404 to user: Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:31:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9ccdb010-9b48-4755-a4a4-39e2efad8b6b tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a" status: 404 len: 111 microversion: 2.87 time: 0.032681 Nov 14 02:31:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 391/1163] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:31:42 2023] GET /compute/v2.1/servers/42cdcf9f-848c-4960-87ca-3a8afa145b6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:49 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:31:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-aae69408-c7f6-4ae9-b2ed-eb9e5ee91dd3 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169" status: 200 len: 1542 microversion: 2.1 time: 0.247264 Nov 14 02:31:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 385/1164] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:31:49 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169 => generated 1542 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-5cb9898b-11f9-4880-9d6b-9ed526164184 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.149859 Nov 14 02:31:51 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 389/1165] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 14 02:31:51 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-interface => generated 283 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:31:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Creating event network-changed:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:31:52 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033171 Nov 14 02:31:52 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 392/1166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f4f9f807-1a8e-462c-816c-c8d08979eee9 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/ips" status: 200 len: 111 microversion: 2.20 time: 0.036076 Nov 14 02:31:52 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 386/1167] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 14 02:31:52 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/ips => generated 111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe could not be found. Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:31:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-17a8b056-37e0-465a-83cf-506c756b2b2c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" status: 404 len: 111 microversion: 2.1 time: 0.027772 Nov 14 02:31:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 390/1168] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:31:53 2023] GET /compute/v2.1/servers/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 could not be found. Nov 14 02:31:53 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:31:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b6f67289-c638-452c-bcb0-2aa3aa94a60c tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 404 len: 111 microversion: 2.1 time: 0.027306 Nov 14 02:31:53 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 393/1169] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:31:53 2023] DELETE /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HTTP exception thrown: Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 could not be found. Nov 14 02:31:53 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Returning 404 to user: Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:31:53 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7573e621-1280-46f0-9d8b-4ef2d0abf32d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" status: 404 len: 111 microversion: 2.1 time: 0.026440 Nov 14 02:31:53 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 387/1170] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:31:53 2023] GET /compute/v2.1/servers/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:53 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'flavor' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:31:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/action" status: 202 len: 0 microversion: 2.20 time: 0.899963 Nov 14 02:31:54 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 391/1171] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:31:53 2023] POST /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/action => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:54 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:55 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:31:55 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:31:55 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:31:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-74c3aa34-d2bb-4467-aca5-d4c0c8495bd1 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 200 len: 1712 microversion: 2.20 time: 0.316882 Nov 14 02:31:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 394/1172] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:31:54 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 1712 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:31:55 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-unplugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:55 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Creating event network-vif-unplugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:31:55 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167040 Nov 14 02:31:55 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 388/1173] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:31:56 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c22ed227-194d-4432-9d29-5b0ad08a6e15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Calling method '.version_select at 0x7fc9e865b2e0>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:31:56 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c22ed227-194d-4432-9d29-5b0ad08a6e15 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1177175426" status: 202 len: 0 microversion: 2.1 time: 0.085958 Nov 14 02:31:56 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 392/1174] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Nov 14 02:31:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1177175426 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 14 02:31:57 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-plugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:31:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:31:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:31:57 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:31:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Creating event network-vif-plugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:31:57 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035823 Nov 14 02:31:57 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 395/1175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:32:00 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:32:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:00 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Creating event network-changed:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:32:00 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030475 Nov 14 02:32:00 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 389/1176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:32:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] HTTP exception thrown: Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 could not be found. Nov 14 02:32:11 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Returning 404 to user: Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:32:11 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-71c950cd-5acb-4d60-9a73-6470e2256615 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1" status: 404 len: 111 microversion: 2.1 time: 0.056544 Nov 14 02:32:11 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 393/1177] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:32:11 2023] GET /compute/v2.1/servers/053d9dbc-02cd-49b3-9476-02b32b4cb4a1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:32:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=10 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:32:11 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=14 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:32:11 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6b44d4c3-bcbd-4fca-9352-9d1f9aa60d4b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Calling method '.version_select at 0x7fc9eb152440>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:32:11 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6b44d4c3-bcbd-4fca-9352-9d1f9aa60d4b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055575446" status: 202 len: 0 microversion: 2.1 time: 0.027840 Nov 14 02:32:11 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 396/1178] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:32:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055575446 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=10 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=16 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:32:45 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:32:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-a37a2d10-1e39-4e47-abae-1aa32bdf33fe tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 200 len: 1653 microversion: 2.20 time: 0.282944 Nov 14 02:32:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 390/1179] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:32:45 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 1653 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:50 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-a7b33eac-c3d1-46d4-aa50-bea4cd192879 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.190344 Nov 14 02:32:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 394/1180] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:32:50 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-interface => generated 282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:32:50 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:51 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:51 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7c83c0f0-3874-40b9-8963-51f732000f04 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/ips" status: 200 len: 107 microversion: 2.1 time: 0.040646 Nov 14 02:32:51 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 391/1181] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:32:51 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/ips => generated 107 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:32:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcfd6b0-46e9-4194-b83c-dbd004cb5169", "tag": "18760f94-6e18-4d6a-8934-5bb624700993"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:32:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Creating event network-changed:18760f94-6e18-4d6a-8934-5bb624700993 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 on user Nov 14 02:32:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248573 Nov 14 02:32:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 397/1182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ac8bc2c-8c58-4af5-a105-58f0fd6f6356"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368075 Nov 14 02:32:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 395/1183] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:32:52 2023] POST /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:59 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'services' on Instance uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:32:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments/5ac8bc2c-8c58-4af5-a105-58f0fd6f6356" status: 202 len: 0 microversion: 2.1 time: 0.177520 Nov 14 02:32:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 392/1184] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:32:59 2023] DELETE /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments/5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:32:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:32:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-09481dbc-c1a1-4bc2-89fc-e9e9ce606fe5 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Nov 14 02:32:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 398/1185] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:32:59 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f82a19d-4b77-48ba-b5b3-7b287572cd7e"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:45 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:45 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-6fababcb-8a07-497e-b1e5-0dae583fa62f tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.512964 Nov 14 02:33:45 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 396/1186] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 14 02:33:45 2023] POST /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-volume_attachments => generated 188 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:46 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:46 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-d5a65a4b-ab7c-4d1b-aa17-1a131b03f91e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-volume_attachments/2f82a19d-4b77-48ba-b5b3-7b287572cd7e" status: 202 len: 0 microversion: 2.20 time: 0.242313 Nov 14 02:33:46 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 393/1187] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 14 02:33:46 2023] DELETE /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-volume_attachments/2f82a19d-4b77-48ba-b5b3-7b287572cd7e => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=8 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:46 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64867) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 14 02:33:46 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/action" status: 202 len: 0 microversion: 2.20 time: 0.105625 Nov 14 02:33:46 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 399/1188] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 14 02:33:46 2023] POST /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:33:46 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:33:46 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-3950f242-4569-43f3-bd95-1e49c02e6606 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 200 len: 1661 microversion: 2.20 time: 0.278641 Nov 14 02:33:46 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 397/1189] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:33:46 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 1661 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:33:48 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:48 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Creating event network-changed:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:33:48 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086959 Nov 14 02:33:48 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 394/1190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:33:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-ef3908a5-4dea-46e0-8807-f8ce5764e74c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054212 Nov 14 02:33:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 400/1191] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:33:49 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:49 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:33:50 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169" status: 204 len: 0 microversion: 2.1 time: 0.121398 Nov 14 02:33:50 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 398/1192] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:33:49 2023] DELETE /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:50 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:33:50 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-822436ba-a289-4512-98b3-4eb21fcdd765 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169" status: 200 len: 1666 microversion: 2.1 time: 0.216253 Nov 14 02:33:50 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 395/1193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:33:50 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169 => generated 1666 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:33:50 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcfd6b0-46e9-4194-b83c-dbd004cb5169", "name": "network-vif-unplugged", "status": "completed", "tag": "18760f94-6e18-4d6a-8934-5bb624700993"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:50 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:50 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Creating event network-vif-unplugged:18760f94-6e18-4d6a-8934-5bb624700993 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 on user Nov 14 02:33:50 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138065 Nov 14 02:33:50 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 401/1194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:33:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:33:52 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcfd6b0-46e9-4194-b83c-dbd004cb5169", "name": "network-vif-deleted", "tag": "18760f94-6e18-4d6a-8934-5bb624700993"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:52 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] Creating event network-vif-deleted:18760f94-6e18-4d6a-8934-5bb624700993 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 on user Nov 14 02:33:52 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033971 Nov 14 02:33:52 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 399/1195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:33:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:33:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcfd6b0-46e9-4194-b83c-dbd004cb5169", "name": "network-vif-plugged", "status": "completed", "tag": "18760f94-6e18-4d6a-8934-5bb624700993"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Creating event network-vif-plugged:18760f94-6e18-4d6a-8934-5bb624700993 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 on user Nov 14 02:33:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034500 Nov 14 02:33:52 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 396/1196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:33:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:33:55 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-plugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:55 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Creating event network-vif-plugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:33:55 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028056 Nov 14 02:33:55 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 402/1197] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:33:58 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-plugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:33:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:33:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:33:58 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:33:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Creating event network-vif-plugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:33:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033066 Nov 14 02:33:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 400/1198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:37 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:34:37 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:34:37 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:34:37 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7cb88f34-5661-4377-ac89-6531cdcbcf49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 200 len: 1706 microversion: 2.20 time: 0.210850 Nov 14 02:34:37 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 397/1199] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:34:36 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 1706 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 could not be found. Nov 14 02:34:40 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:40 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-983a972b-c2de-4cca-83f5-0da19a3444dc tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169" status: 404 len: 111 microversion: 2.1 time: 0.042248 Nov 14 02:34:40 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 403/1200] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:34:40 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:40 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:34:40 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:34:40 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-e59c972c-d7ed-4646-bc24-aa6106fa2043 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '.version_select at 0x7fc9e86d1120>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:40 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-e59c972c-d7ed-4646-bc24-aa6106fa2043 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397251301" status: 202 len: 0 microversion: 2.1 time: 0.030604 Nov 14 02:34:40 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 401/1201] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:34:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397251301 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:42 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 could not be found. Nov 14 02:34:42 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:42 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f6de6f76-be3b-45d4-9555-384774104f0e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169" status: 404 len: 111 microversion: 2.1 time: 0.028162 Nov 14 02:34:42 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 398/1202] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:34:42 2023] DELETE /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 could not be found. Nov 14 02:34:42 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:42 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-e96434f4-00bf-4c2f-b7bf-fb16b48ed264 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169" status: 404 len: 111 microversion: 2.1 time: 0.026033 Nov 14 02:34:42 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 404/1203] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:34:42 2023] GET /compute/v2.1/servers/9fcfd6b0-46e9-4194-b83c-dbd004cb5169 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 could not be found. Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-c86dd09e-6272-4127-ba73-3de739ba815b tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26" status: 404 len: 111 microversion: 2.1 time: 0.028599 Nov 14 02:34:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 402/1204] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:34:43 2023] DELETE /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 could not be found. Nov 14 02:34:43 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b166c11e-6b4f-4447-b9da-8b9125d2d789 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26" status: 404 len: 111 microversion: 2.1 time: 0.034808 Nov 14 02:34:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 399/1205] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:34:43 2023] GET /compute/v2.1/servers/0e80866e-d70f-411d-a38b-78c2d1dbdc26 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 could not be found. Nov 14 02:34:43 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:43 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-5a6d4667-b52e-4b60-bfd6-6750ade5b389 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3" status: 404 len: 111 microversion: 2.1 time: 0.026933 Nov 14 02:34:43 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 405/1206] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:34:43 2023] DELETE /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 could not be found. Nov 14 02:34:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-09c70624-cd99-4e71-a7a4-46c589998d48 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3" status: 404 len: 111 microversion: 2.1 time: 0.027633 Nov 14 02:34:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 403/1207] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:34:43 2023] GET /compute/v2.1/servers/dcca61ed-4b5a-4966-8584-bde4f1954eb3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be could not be found. Nov 14 02:34:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:44 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-2da0c315-99da-43ab-8ea0-9b9d7590949e tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be" status: 404 len: 111 microversion: 2.1 time: 0.031557 Nov 14 02:34:44 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 400/1208] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:34:44 2023] DELETE /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:34:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HTTP exception thrown: Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be could not be found. Nov 14 02:34:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Returning 404 to user: Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:34:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-a0185f7f-d0ba-4e89-b6f5-416f9c2cc6da tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be" status: 404 len: 111 microversion: 2.1 time: 0.028463 Nov 14 02:34:44 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 406/1209] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:34:44 2023] GET /compute/v2.1/servers/6bc79fc1-8d23-443f-99b5-2464e115a1be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1570952757", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "609cdccf-0cd2-43bf-a056-920b23dd9b1b"}]}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.network.neutron [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] validate_networks() for [('609cdccf-0cd2-43bf-a056-920b23dd9b1b', None, None, None, None, None)] {{(pid=64868) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image limits 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image pref 0:0:0 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Getting quotas for project ff8f466148e94fc6b7ed0ae1722e5960. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Getting quotas for user 9320e58d50b14b298b8aafc11b3afe05 and project ff8f466148e94fc6b7ed0ae1722e5960. Resources: {'ram', 'instances', 'cores'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Going to run 1 instances... {{(pid=64868) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:35:02 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:35:02 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.529546 Nov 14 02:35:02 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 404/1210] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:35:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:35:02 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-5127ee6e-8fb5-4996-9903-8be87eab21ca tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:35:02 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-5127ee6e-8fb5-4996-9903-8be87eab21ca tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:35:02 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:35:02 user devstack@n-api.service[64866]: Tue Nov 14 02:35:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea (ip 10.0.0.210) !!! Nov 14 02:35:02 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:02 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=12 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:02 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-5127ee6e-8fb5-4996-9903-8be87eab21ca tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:35:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-5127ee6e-8fb5-4996-9903-8be87eab21ca tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea" status: 200 len: 1206 microversion: 2.1 time: 0.080015 Nov 14 02:35:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 401/1211] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:35:02 2023] GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea => generated 1206 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:35:04 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e8b92d-057a-4979-a993-d70a64d45fea", "tag": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:35:04 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=8 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:04 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=8 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:04 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Creating event network-changed:c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance 15e8b92d-057a-4979-a993-d70a64d45fea on user Nov 14 02:35:04 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035497 Nov 14 02:35:04 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 407/1212] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:35:06 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8b92d-057a-4979-a993-d70a64d45fea", "name": "network-vif-plugged", "status": "completed", "tag": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:35:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Creating event network-vif-plugged:c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance 15e8b92d-057a-4979-a993-d70a64d45fea on user Nov 14 02:35:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 Nov 14 02:35:06 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 405/1213] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:35:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:35:08 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8b92d-057a-4979-a993-d70a64d45fea", "name": "network-vif-plugged", "status": "completed", "tag": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:35:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:08 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Creating event network-vif-plugged:c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance 15e8b92d-057a-4979-a993-d70a64d45fea on user Nov 14 02:35:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031499 Nov 14 02:35:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 402/1214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:35:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:37 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:37 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b0a6a4f5-92cf-4994-865f-72ca565d9dd2 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048949 Nov 14 02:35:37 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 408/1215] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 14 02:35:37 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:37 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:35:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 204 len: 0 microversion: 2.20 time: 0.169699 Nov 14 02:35:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 406/1216] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:35:37 2023] DELETE /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:37 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:38 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:35:38 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:35:38 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:35:38 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-669b45af-7247-4a1a-857d-81b4b484aa77 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 200 len: 1712 microversion: 2.20 time: 0.652114 Nov 14 02:35:38 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 403/1217] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:35:37 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 1712 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 14 02:35:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-unplugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:35:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Creating event network-vif-unplugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:35:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028015 Nov 14 02:35:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 409/1218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:35:39 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-deleted", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:35:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:39 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] Creating event network-vif-deleted:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:35:39 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028095 Nov 14 02:35:39 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 407/1219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:35:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b4d4a3-50f6-4381-92ab-01ce730ecb54", "name": "network-vif-plugged", "status": "completed", "tag": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:35:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Creating event network-vif-plugged:b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 on user Nov 14 02:35:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029647 Nov 14 02:35:40 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 404/1220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:35:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=8 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:35:52 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:35:53 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:35:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-d97fd8ba-6026-452c-a7cf-87f91e252e27 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea" status: 200 len: 1483 microversion: 2.1 time: 0.328402 Nov 14 02:35:53 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 410/1221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:35:52 2023] GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea => generated 1483 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:36:28 user devstack@n-api.service[64868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fc2f10d-3803-4556-82f7-81e757c89f03] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] HTTP exception thrown: Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 could not be found. Nov 14 02:36:28 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Returning 404 to user: Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:36:28 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7ce4aa71-614b-4b2f-b323-215e245819cd tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 404 len: 111 microversion: 2.20 time: 0.070064 Nov 14 02:36:28 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 408/1222] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:36:28 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:36:28 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:28 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:28 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-0348573d-82d9-4d2a-8a21-c7160429eff3 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '.version_select at 0x7fc9eb185ea0>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:28 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-0348573d-82d9-4d2a-8a21-c7160429eff3 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707904333" status: 204 len: 0 microversion: 2.20 time: 0.030577 Nov 14 02:36:28 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 405/1223] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 14 02:36:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707904333 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] HTTP exception thrown: Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 could not be found. Nov 14 02:36:31 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Returning 404 to user: Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:36:31 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-dc23d3d7-dd97-4fc9-9d37-c991dc0fbd6e tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 404 len: 111 microversion: 2.20 time: 0.029706 Nov 14 02:36:31 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 411/1224] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:36:31 2023] DELETE /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:31 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fc2f10d-3803-4556-82f7-81e757c89f03] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47816. Nov 14 02:36:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] HTTP exception thrown: Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 could not be found. Nov 14 02:36:31 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Returning 404 to user: Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:36:31 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-f5a61c1b-67c8-46ed-8baf-c76f330c3be4 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54" status: 404 len: 111 microversion: 2.20 time: 0.047602 Nov 14 02:36:31 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 409/1225] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:36:31 2023] GET /compute/v2.1/servers/d4b4d4a3-50f6-4381-92ab-01ce730ecb54 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:32 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] HTTP exception thrown: Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc could not be found. Nov 14 02:36:32 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Returning 404 to user: Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:36:32 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-ead7267c-edea-47ce-89be-d3ad79877a63 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 404 len: 111 microversion: 2.20 time: 0.037238 Nov 14 02:36:32 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 406/1226] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 14 02:36:32 2023] DELETE /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:32 user devstack@n-api.service[64867]: INFO nova.api.openstack.wsgi [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] HTTP exception thrown: Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc could not be found. Nov 14 02:36:32 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Returning 404 to user: Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc could not be found. {{(pid=64867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:36:32 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-25cc0d40-284c-4e77-9b39-fbd1e5609d25 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" status: 404 len: 111 microversion: 2.20 time: 0.027705 Nov 14 02:36:32 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 412/1227] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 14 02:36:32 2023] GET /compute/v2.1/servers/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:53 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:36:53 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea" status: 204 len: 0 microversion: 2.1 time: 0.138878 Nov 14 02:36:53 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 410/1228] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:36:53 2023] DELETE /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:53 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:53 user devstack@n-api.service[64867]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 14 02:36:53 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8b92d-057a-4979-a993-d70a64d45fea", "name": "network-vif-unplugged", "status": "completed", "tag": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:36:53 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:53 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:36:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:53 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Creating event network-vif-unplugged:c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance 15e8b92d-057a-4979-a993-d70a64d45fea on user Nov 14 02:36:53 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035686 Nov 14 02:36:53 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 413/1229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:36:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:36:54 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:36:54 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-bf7b9ea0-a749-45df-93ed-6d8ce333b131 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea" status: 200 len: 1489 microversion: 2.1 time: 0.516576 Nov 14 02:36:54 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 407/1230] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:36:53 2023] GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea => generated 1489 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:36:55 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8b92d-057a-4979-a993-d70a64d45fea", "name": "network-vif-plugged", "status": "completed", "tag": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3"}, {"server_uuid": "15e8b92d-057a-4979-a993-d70a64d45fea", "name": "network-vif-deleted", "tag": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:36:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:55 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:55 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Creating event network-vif-plugged:c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance 15e8b92d-057a-4979-a993-d70a64d45fea on user Nov 14 02:36:55 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Creating event network-vif-deleted:c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance 15e8b92d-057a-4979-a993-d70a64d45fea on user Nov 14 02:36:55 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039813 Nov 14 02:36:55 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 411/1231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:36:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2021763470", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:36:58 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51866. Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] validate_networks() for None {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:36:58 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:36:59 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Getting quotas for project 15568f7c994d4677a200047d5f9081a8. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:36:59 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Getting quotas for user 892f482ffc0d40bc9e1309d41a49ff1b and project 15568f7c994d4677a200047d5f9081a8. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:36:59 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:36:59 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:36:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.412608 Nov 14 02:36:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 414/1232] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:36:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:36:59 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-88c14ca2-e745-4438-b1af-c83d02ee7aab tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:36:59 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-88c14ca2-e745-4438-b1af-c83d02ee7aab tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:36:59 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-88c14ca2-e745-4438-b1af-c83d02ee7aab tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892f482ffc0d40bc9e1309d41a49ff1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15568f7c994d4677a200047d5f9081a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:36:59 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-88c14ca2-e745-4438-b1af-c83d02ee7aab tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878" status: 200 len: 1207 microversion: 2.1 time: 0.071001 Nov 14 02:36:59 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 408/1233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:36:59 2023] GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878 => generated 1207 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:37:01 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5165f229-85ea-4bba-abe7-d2ea8f777878", "tag": "a2234980-33ea-4b64-a2fd-8e09f63cb010"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:37:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:01 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Creating event network-changed:a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance 5165f229-85ea-4bba-abe7-d2ea8f777878 on user Nov 14 02:37:01 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033644 Nov 14 02:37:01 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 412/1234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:37:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:37:03 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5165f229-85ea-4bba-abe7-d2ea8f777878", "name": "network-vif-plugged", "status": "completed", "tag": "a2234980-33ea-4b64-a2fd-8e09f63cb010"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:37:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:03 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Creating event network-vif-plugged:a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance 5165f229-85ea-4bba-abe7-d2ea8f777878 on user Nov 14 02:37:03 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032012 Nov 14 02:37:03 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 415/1235] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:37:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:37:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5165f229-85ea-4bba-abe7-d2ea8f777878", "name": "network-vif-plugged", "status": "completed", "tag": "a2234980-33ea-4b64-a2fd-8e09f63cb010"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:37:05 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Creating event network-vif-plugged:a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance 5165f229-85ea-4bba-abe7-d2ea8f777878 on user Nov 14 02:37:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034149 Nov 14 02:37:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 409/1236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] HTTP exception thrown: Instance 15e8b92d-057a-4979-a993-d70a64d45fea could not be found. Nov 14 02:37:44 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Returning 404 to user: Instance 15e8b92d-057a-4979-a993-d70a64d45fea could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:37:44 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-352717b9-cb97-41aa-8a42-0b753a225790 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea" status: 404 len: 111 microversion: 2.1 time: 0.038002 Nov 14 02:37:44 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 413/1237] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:37:44 2023] GET /compute/v2.1/servers/15e8b92d-057a-4979-a993-d70a64d45fea => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1179334455", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "networks": [{"uuid": "609cdccf-0cd2-43bf-a056-920b23dd9b1b"}]}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.network.neutron [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] validate_networks() for [('609cdccf-0cd2-43bf-a056-920b23dd9b1b', None, None, None, None, None)] {{(pid=64867) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image limits 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image pref 0:0:0 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Getting quotas for project ff8f466148e94fc6b7ed0ae1722e5960. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Getting quotas for user 9320e58d50b14b298b8aafc11b3afe05 and project ff8f466148e94fc6b7ed0ae1722e5960. Resources: {'ram', 'instances', 'cores'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Going to run 1 instances... {{(pid=64867) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:37:44 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:37:44 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.573380 Nov 14 02:37:44 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 416/1238] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:37:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:37:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:37:44 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-b7136908-759d-4ea4-92b6-49e498764f72 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:37:44 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-b7136908-759d-4ea4-92b6-49e498764f72 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:37:45 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-b7136908-759d-4ea4-92b6-49e498764f72 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:37:45 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-b7136908-759d-4ea4-92b6-49e498764f72 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59" status: 200 len: 1206 microversion: 2.1 time: 0.073117 Nov 14 02:37:45 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 410/1239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:37:44 2023] GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59 => generated 1206 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:37:47 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a919147-feb1-4f0b-9571-f5b3e8edaa59", "tag": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:37:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:47 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Creating event network-changed:dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 on user Nov 14 02:37:47 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033966 Nov 14 02:37:47 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 414/1240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:37:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:37:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a919147-feb1-4f0b-9571-f5b3e8edaa59", "name": "network-vif-plugged", "status": "completed", "tag": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Creating event network-vif-plugged:dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 on user Nov 14 02:37:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050218 Nov 14 02:37:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 411/1241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:37:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:37:49 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892f482ffc0d40bc9e1309d41a49ff1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15568f7c994d4677a200047d5f9081a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:37:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6b416afe-48ef-47b9-82c0-ca8deb0f9b51 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878" status: 200 len: 1453 microversion: 2.1 time: 0.248234 Nov 14 02:37:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 417/1242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:37:49 2023] GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878 => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:37:51 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a919147-feb1-4f0b-9571-f5b3e8edaa59", "name": "network-vif-plugged", "status": "completed", "tag": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:37:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:37:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:37:51 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:37:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Creating event network-vif-plugged:dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 on user Nov 14 02:37:51 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214298 Nov 14 02:37:51 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 415/1243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:37:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:35 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:38:35 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6e42e7e2-b4be-4696-9ab8-4dacb98776bb tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59" status: 200 len: 1483 microversion: 2.1 time: 0.229665 Nov 14 02:38:35 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 412/1244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:38:35 2023] GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59 => generated 1483 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=8 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:49 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:38:49 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878" status: 204 len: 0 microversion: 2.1 time: 0.125618 Nov 14 02:38:49 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 418/1245] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:38:49 2023] DELETE /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:38:49 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:38:49 user devstack@n-api.service[64868]: Tue Nov 14 02:38:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878 (ip 10.0.0.210) !!! Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:49 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:38:49 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5165f229-85ea-4bba-abe7-d2ea8f777878", "name": "network-vif-unplugged", "status": "completed", "tag": "a2234980-33ea-4b64-a2fd-8e09f63cb010"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:38:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:49 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:49 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892f482ffc0d40bc9e1309d41a49ff1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15568f7c994d4677a200047d5f9081a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:38:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Creating event network-vif-unplugged:a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance 5165f229-85ea-4bba-abe7-d2ea8f777878 on user Nov 14 02:38:49 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100540 Nov 14 02:38:49 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0fc6514a-d86f-48d1-93e9-8284ef42fd62 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878" status: 200 len: 1459 microversion: 2.1 time: 0.324776 Nov 14 02:38:49 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 416/1247] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:38:49 2023] GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878 => generated 1459 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:38:49 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 413/1247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:38:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:38:51 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5165f229-85ea-4bba-abe7-d2ea8f777878", "name": "network-vif-plugged", "status": "completed", "tag": "a2234980-33ea-4b64-a2fd-8e09f63cb010"}, {"server_uuid": "5165f229-85ea-4bba-abe7-d2ea8f777878", "name": "network-vif-deleted", "tag": "a2234980-33ea-4b64-a2fd-8e09f63cb010"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:38:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:38:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:38:51 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:38:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Creating event network-vif-plugged:a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance 5165f229-85ea-4bba-abe7-d2ea8f777878 on user Nov 14 02:38:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Creating event network-vif-deleted:a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance 5165f229-85ea-4bba-abe7-d2ea8f777878 on user Nov 14 02:38:51 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028760 Nov 14 02:38:51 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 419/1248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:38:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:35 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:39:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59" status: 204 len: 0 microversion: 2.1 time: 0.207914 Nov 14 02:39:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 417/1249] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:39:35 2023] DELETE /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:39:36 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:39:36 user devstack@n-api.service[64866]: Tue Nov 14 02:39:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59 (ip 10.0.0.210) !!! Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:36 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:39:36 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:39:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a919147-feb1-4f0b-9571-f5b3e8edaa59", "name": "network-vif-unplugged", "status": "completed", "tag": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:39:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Creating event network-vif-unplugged:dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 on user Nov 14 02:39:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038624 Nov 14 02:39:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 420/1250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:39:36 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:39:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7dd09188-2df9-489a-84e6-2c2759e268f7 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59" status: 200 len: 1489 microversion: 2.1 time: 0.278399 Nov 14 02:39:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 414/1251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:39:36 2023] GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59 => generated 1489 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:39:37 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a919147-feb1-4f0b-9571-f5b3e8edaa59", "name": "network-vif-deleted", "tag": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:39:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:37 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] Creating event network-vif-deleted:dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 on user Nov 14 02:39:37 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029056 Nov 14 02:39:37 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 418/1252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:39:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:39:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a919147-feb1-4f0b-9571-f5b3e8edaa59", "name": "network-vif-plugged", "status": "completed", "tag": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:39:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Creating event network-vif-plugged:dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 on user Nov 14 02:39:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030624 Nov 14 02:39:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 421/1253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:39:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] HTTP exception thrown: Instance 5165f229-85ea-4bba-abe7-d2ea8f777878 could not be found. Nov 14 02:39:40 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Returning 404 to user: Instance 5165f229-85ea-4bba-abe7-d2ea8f777878 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:39:40 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-1130a589-07cd-4ced-8d86-6671d2154050 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878" status: 404 len: 111 microversion: 2.1 time: 0.027145 Nov 14 02:39:40 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 415/1254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:39:39 2023] GET /compute/v2.1/servers/5165f229-85ea-4bba-abe7-d2ea8f777878 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:40:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.wsgi [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] HTTP exception thrown: Instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 could not be found. Nov 14 02:40:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Returning 404 to user: Instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 could not be found. {{(pid=64868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:40:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-7b863961-8471-468c-bafc-23a5639b9ea3 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59" status: 404 len: 111 microversion: 2.1 time: 0.232528 Nov 14 02:40:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 419/1255] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:40:26 2023] GET /compute/v2.1/servers/7a919147-feb1-4f0b-9571-f5b3e8edaa59 => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:41:39 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:39 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:39 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:41:39 user devstack@n-api.service[64867]: Tue Nov 14 02:41:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 14 02:41:39 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:41:39 user devstack@n-api.service[64867]: Tue Nov 14 02:41:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 14 02:41:39 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-69caf10d-1942-4ea2-af1a-8e2a1b0a519b tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Action: 'create', calling method: .version_select at 0x7fc9eafbba30>, body: {"keypair": {"name": "tempest-TestShelveInstance-25028662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mk3N2i+vDUBlc+/tR7tW4k+Hjxc54ts/bXTLbzJJIp+qzJkzPf9i3LPF9l/pgKd1pjqRhsKai74htofsle53vM8QNltKsuYG+hkntScDGvtmWRDNYiiKOJZv0tYctKQ=="}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:41:39 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-69caf10d-1942-4ea2-af1a-8e2a1b0a519b tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting quotas for project e4669185f0a240bda390f3dfd67e3144. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:41:39 user devstack@n-api.service[64867]: DEBUG nova.quota [None req-69caf10d-1942-4ea2-af1a-8e2a1b0a519b tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting quotas for user 14b78c0b5e3b4e9f826162a9e17ca8bb and project e4669185f0a240bda390f3dfd67e3144. Resources: {'key_pairs'} {{(pid=64867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:41:39 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-69caf10d-1942-4ea2-af1a-8e2a1b0a519b tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.254570 Nov 14 02:41:39 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 422/1256] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:41:39 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:41:42 user devstack@n-api.service[64866]: ERROR oslo.messaging._drivers.impl_rabbit [-] [362d7433-f206-43d1-b977-683f5dc2fd03] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 14 02:41:42 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:42 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=8 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:42 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:41:42 user devstack@n-api.service[64866]: Tue Nov 14 02:41:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 14 02:41:42 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:41:42 user devstack@n-api.service[64866]: Tue Nov 14 02:41:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 14 02:41:42 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1225809098", "imageRef": "", "flavorRef": "1", "key_name": "tempest-TestShelveInstance-25028662", "security_groups": [{"name": "tempest-secgroup-smoke-2115239809"}], "networks": [{"uuid": "76e82c84-1e7b-498a-b1c2-3441bd656ce4"}], "block_device_mapping_v2": [{"uuid": "54e9e8d7-718b-49aa-97f6-f175733eacfc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:41:42 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] validate_networks() for [('76e82c84-1e7b-498a-b1c2-3441bd656ce4', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting quotas for project e4669185f0a240bda390f3dfd67e3144. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting quotas for user 14b78c0b5e3b4e9f826162a9e17ca8bb and project e4669185f0a240bda390f3dfd67e3144. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:41:43 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54e9e8d7-718b-49aa-97f6-f175733eacfc',volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:41:43 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.773802 Nov 14 02:41:43 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 416/1257] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:41:42 2023] POST /compute/v2.1/servers => generated 404 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:41:43 user devstack@n-api.service[64868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fc2f10d-3803-4556-82f7-81e757c89f03] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 14 02:41:43 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:43 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:43 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:41:43 user devstack@n-api.service[64868]: Tue Nov 14 02:41:43 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 (ip 10.0.0.210) !!! Nov 14 02:41:43 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d95d3606-8200-4789-abb2-8622d69e2154 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:41:43 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d95d3606-8200-4789-abb2-8622d69e2154 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:41:43 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-d95d3606-8200-4789-abb2-8622d69e2154 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:41:43 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d95d3606-8200-4789-abb2-8622d69e2154 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1080 microversion: 2.1 time: 0.080697 Nov 14 02:41:43 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 420/1258] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:41:43 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1080 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:41:45 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:41:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:41:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:41:45 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:41:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Creating event network-changed:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:41:45 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029468 Nov 14 02:41:45 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 423/1259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:41:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:41:52 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:41:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:41:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:41:52 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:41:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Creating event network-vif-plugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:41:52 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] [362d7433-f206-43d1-b977-683f5dc2fd03] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60900. Nov 14 02:41:52 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036901 Nov 14 02:41:52 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 417/1260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:41:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:41:54 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:41:54 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:54 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:41:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:41:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:41:54 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:41:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Creating event network-vif-plugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:41:54 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041706 Nov 14 02:41:54 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 421/1261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:42:33 user devstack@n-api.service[64867]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:42:33 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:42:33 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-388aff26-6226-4d5b-a8ef-01bf0e82d3c5 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1431 microversion: 2.1 time: 0.268878 Nov 14 02:42:33 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 424/1262] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:42:33 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1431 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:34 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:43:34 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-68633d3a-a784-4f67-95bc-8dc44a643186 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1431 microversion: 2.1 time: 0.307541 Nov 14 02:43:34 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 418/1263] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:43:34 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1431 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:43:35 user devstack@n-api.service[64868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fc2f10d-3803-4556-82f7-81e757c89f03] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 14 02:43:35 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:35 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:35 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:43:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:35 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Creating event network-changed:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:43:35 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091721 Nov 14 02:43:35 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 422/1264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:43:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:36 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57724. Nov 14 02:43:36 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'flavor' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:43:36 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/action" status: 202 len: 0 microversion: 2.1 time: 0.106497 Nov 14 02:43:36 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 425/1265] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:43:36 2023] POST /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:36 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:43:36 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-be95dd4a-18db-4d20-be36-4dcf5eaf3263 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1556 microversion: 2.1 time: 0.182900 Nov 14 02:43:36 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 419/1266] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:43:36 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1556 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:43:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-unplugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:43:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Creating event network-vif-unplugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:43:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029422 Nov 14 02:43:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 423/1267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:43:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:43:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}, {"name": "network-changed", "server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:43:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:43:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:43:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:43:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Creating event network-vif-plugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:43:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Creating event network-changed:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:43:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.031458 Nov 14 02:43:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 426/1268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:43:38 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=12 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:44:26 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:44:26 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-7ecfb515-a63d-4d8f-b454-5a8ee7595b43 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1497 microversion: 2.1 time: 0.207158 Nov 14 02:44:26 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 420/1269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:44:26 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:26 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:45:26 user devstack@n-api.service[64868]: Tue Nov 14 02:45:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/action (ip 10.0.0.210) !!! Nov 14 02:45:26 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:45:26 user devstack@n-api.service[64868]: Tue Nov 14 02:45:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/action (ip 10.0.0.210) !!! Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:45:26 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fc2f10d-3803-4556-82f7-81e757c89f03] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51020. Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:45:26 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64868) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 14 02:45:26 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/action" status: 202 len: 0 microversion: 2.1 time: 0.257334 Nov 14 02:45:26 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 424/1270] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 14 02:45:26 2023] POST /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:45:27 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:45:27 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-6ee151db-fabc-4c4f-8e73-7b89f7a2152f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1505 microversion: 2.1 time: 0.228201 Nov 14 02:45:27 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 427/1271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:45:26 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:45:33 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:33 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:33 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:45:33 user devstack@n-api.service[64866]: Tue Nov 14 02:45:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 14 02:45:33 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:45:33 user devstack@n-api.service[64866]: Tue Nov 14 02:45:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 14 02:45:33 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:45:33 user devstack@n-api.service[64866]: Tue Nov 14 02:45:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 14 02:45:33 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:45:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:45:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:45:33 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:45:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Creating event network-changed:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:45:33 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108902 Nov 14 02:45:33 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 421/1272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:45:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:45:36 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:45:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:45:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:45:36 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:45:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Creating event network-vif-plugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:45:36 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040219 Nov 14 02:45:36 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 425/1273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:45:38 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:45:38 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:38 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:45:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:45:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:45:38 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:45:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Creating event network-vif-plugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:45:38 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033305 Nov 14 02:45:38 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 428/1274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:45:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:46:17 user devstack@n-api.service[64866]: ERROR oslo.messaging._drivers.impl_rabbit [-] [362d7433-f206-43d1-b977-683f5dc2fd03] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:46:17 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:46:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-8a0b78a7-6a5c-4a21-b936-8de438f37a51 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1550 microversion: 2.1 time: 0.556138 Nov 14 02:46:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 422/1275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:46:17 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1550 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:47:18 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:47:18 user devstack@n-api.service[64867]: Tue Nov 14 02:47:18 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 14 02:47:18 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:47:18 user devstack@n-api.service[64867]: Tue Nov 14 02:47:18 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 14 02:47:18 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:47:18 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:47:18 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:47:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:47:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:47:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:47:18 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Going to try to terminate instance {{(pid=64868) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:47:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Creating event network-changed:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:47:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050572 Nov 14 02:47:18 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 429/1276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:47:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:47:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 204 len: 0 microversion: 2.1 time: 0.187321 Nov 14 02:47:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 426/1277] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:47:18 2023] DELETE /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:47:19 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] [362d7433-f206-43d1-b977-683f5dc2fd03] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60232. Nov 14 02:47:19 user devstack@n-api.service[64866]: DEBUG nova.policy [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64866) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:47:19 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-4641630e-a4e7-4f28-a584-0f428444a882 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 200 len: 1556 microversion: 2.1 time: 0.277700 Nov 14 02:47:19 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 423/1278] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:47:19 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 1556 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:47:19 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-unplugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:47:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:47:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:47:19 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:47:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Creating event network-vif-unplugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:47:19 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028679 Nov 14 02:47:19 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 430/1279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:47:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:47:21 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}, {"server_uuid": "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0", "name": "network-vif-deleted", "tag": "4a97df88-0ca9-4a23-878d-0f9377845397"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:47:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:47:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:47:21 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:47:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Creating event network-vif-plugged:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:47:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Creating event network-vif-deleted:4a97df88-0ca9-4a23-878d-0f9377845397 for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 on user Nov 14 02:47:21 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044050 Nov 14 02:47:21 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 427/1280] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:48:09 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] HTTP exception thrown: Instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 could not be found. Nov 14 02:48:09 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Returning 404 to user: Instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:48:09 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-71d390f0-1c41-4336-8ade-2a81792c732c tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" status: 404 len: 111 microversion: 2.1 time: 0.036633 Nov 14 02:48:09 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 424/1281] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:48:09 2023] GET /compute/v2.1/servers/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:48:09 user devstack@n-api.service[64867]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 14 02:48:09 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:48:09 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=4 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:48:09 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-cdc10cf2-ebb3-4f20-b2be-ca19347758c4 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Calling method '.version_select at 0x7fc9eb1516c0>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:48:09 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-cdc10cf2-ebb3-4f20-b2be-ca19347758c4 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-25028662" status: 202 len: 0 microversion: 2.1 time: 0.035253 Nov 14 02:48:09 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 431/1282] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 14 02:48:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-25028662 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:49:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:02 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:02 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:49:02 user devstack@n-api.service[64868]: Tue Nov 14 02:49:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 14 02:49:02 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:49:02 user devstack@n-api.service[64868]: Tue Nov 14 02:49:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 14 02:49:03 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-df54b66a-05e6-4125-bc4e-97d9748c7985 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Action: 'create', calling method: .version_select at 0x7fc9e86d1b40>, body: {"keypair": {"name": "tempest-keypair-1667210968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/2/dChEzGh99fomls9GfeKvtqveWShI3UeXT2IxIahh0o6gchHk+4rIR33V5V196DsPnNW6gCOEJAbpSTc5tdg71kK0o80z4NtrbrY33vPOdAh40qhkOOrdLaMFHg74A=="}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:49:03 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-df54b66a-05e6-4125-bc4e-97d9748c7985 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting quotas for project 44d92f0c85bd4b20a76d315b1fff8f81. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:49:03 user devstack@n-api.service[64868]: DEBUG nova.quota [None req-df54b66a-05e6-4125-bc4e-97d9748c7985 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting quotas for user b4bd8164c6734205b8e41e74b0ce832e and project 44d92f0c85bd4b20a76d315b1fff8f81. Resources: {'key_pairs'} {{(pid=64868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:49:03 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-df54b66a-05e6-4125-bc4e-97d9748c7985 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.337605 Nov 14 02:49:03 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 428/1283] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 14 02:49:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:49:06 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1804523011", "imageRef": "ccff493f-43f6-4683-9bdc-984e861f9bf9", "flavorRef": "1", "key_name": "tempest-keypair-1667210968", "security_groups": [{"name": "tempest-secgroup-smoke-253429825"}, {"name": "tempest-securitygroup--2098151690"}], "networks": [{"uuid": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:49:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.network.neutron [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] validate_networks() for [('c97f0d3b-1ac4-4af4-8224-eb7042bf8a92', None, None, None, None, None)] {{(pid=64866) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flavor limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Image limits 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flavor pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Image pref 0:0:0 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting quotas for project 44d92f0c85bd4b20a76d315b1fff8f81. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.quota [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting quotas for user b4bd8164c6734205b8e41e74b0ce832e and project 44d92f0c85bd4b20a76d315b1fff8f81. Resources: {'ram', 'instances', 'cores'} {{(pid=64866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Going to run 1 instances... {{(pid=64866) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 14 02:49:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccff493f-43f6-4683-9bdc-984e861f9bf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 14 02:49:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 450 microversion: 2.1 time: 0.992549 Nov 14 02:49:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 425/1284] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 14 02:49:06 2023] POST /compute/v2.1/servers => generated 450 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 14 02:49:07 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-c0fa3f23-ec4e-4446-b222-b59488c20e63 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:49:07 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-c0fa3f23-ec4e-4446-b222-b59488c20e63 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:49:07 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53406. Nov 14 02:49:07 user devstack@n-api.service[64867]: DEBUG nova.policy [None req-c0fa3f23-ec4e-4446-b222-b59488c20e63 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bd8164c6734205b8e41e74b0ce832e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d92f0c85bd4b20a76d315b1fff8f81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64867) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:49:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-c0fa3f23-ec4e-4446-b222-b59488c20e63 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25" status: 200 len: 1236 microversion: 2.1 time: 0.238433 Nov 14 02:49:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 432/1285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:49:07 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 => generated 1236 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:49:10 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f5ddb7-07d4-46a4-8428-6558a0ffcc25", "tag": "10c48d81-cc93-41f7-93b5-8ec30223a387"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:49:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:49:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:49:10 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:49:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Creating event network-changed:10c48d81-cc93-41f7-93b5-8ec30223a387 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 on user Nov 14 02:49:10 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033211 Nov 14 02:49:10 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 429/1286] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:49:13 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f5ddb7-07d4-46a4-8428-6558a0ffcc25", "name": "network-vif-plugged", "status": "completed", "tag": "10c48d81-cc93-41f7-93b5-8ec30223a387"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:49:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:49:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:49:13 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:49:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Creating event network-vif-plugged:10c48d81-cc93-41f7-93b5-8ec30223a387 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 on user Nov 14 02:49:13 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.715436 Nov 14 02:49:13 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 426/1287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:49:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f5ddb7-07d4-46a4-8428-6558a0ffcc25", "name": "network-vif-plugged", "status": "completed", "tag": "10c48d81-cc93-41f7-93b5-8ec30223a387"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:49:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:49:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:49:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:49:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Creating event network-vif-plugged:10c48d81-cc93-41f7-93b5-8ec30223a387 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 on user Nov 14 02:49:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032806 Nov 14 02:49:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 433/1288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell0:SELECT=4 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:57 user devstack@n-api.service[64868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fc2f10d-3803-4556-82f7-81e757c89f03] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:49:57 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:49:58 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bd8164c6734205b8e41e74b0ce832e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d92f0c85bd4b20a76d315b1fff8f81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:49:58 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-af77be42-2eae-4786-a8d2-2456b1aa3c1a tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25" status: 200 len: 1595 microversion: 2.1 time: 0.253757 Nov 14 02:49:58 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 430/1289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:49:57 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 => generated 1595 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell0:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:58 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:50:58 user devstack@n-api.service[64866]: Tue Nov 14 02:50:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-interface (ip 10.0.0.210) !!! Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:50:58 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:50:58 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6bb6a898-f5ed-4cb7-ba7a-b76558d6aa80 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.159255 Nov 14 02:50:58 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 427/1290] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 14 02:50:58 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-interface => generated 283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:50:59 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell0:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:59 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:50:59 user devstack@n-api.service[64867]: Tue Nov 14 02:50:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 14 02:50:59 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:50:59 user devstack@n-api.service[64867]: Tue Nov 14 02:50:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 14 02:50:59 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:59 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:59 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f5ddb7-07d4-46a4-8428-6558a0ffcc25", "tag": "10c48d81-cc93-41f7-93b5-8ec30223a387"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:50:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:50:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:50:59 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:50:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Creating event network-changed:10c48d81-cc93-41f7-93b5-8ec30223a387 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 on user Nov 14 02:50:59 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042996 Nov 14 02:50:59 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 434/1291] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:50:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:50:59 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fc2f10d-3803-4556-82f7-81e757c89f03] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60808. Nov 14 02:50:59 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bd8164c6734205b8e41e74b0ce832e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d92f0c85bd4b20a76d315b1fff8f81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:50:59 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-d5039bf3-5c7f-451e-ab6d-8b4897e3a10f tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25" status: 200 len: 1595 microversion: 2.1 time: 0.315531 Nov 14 02:50:59 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 431/1292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:50:59 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 => generated 1595 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:51:01 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:51:02 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315092 Nov 14 02:51:02 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 428/1293] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:51:01 2023] POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:51:15 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'services' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:51:15 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb" status: 202 len: 0 microversion: 2.1 time: 0.179864 Nov 14 02:51:15 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 435/1294] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:51:15 2023] DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:51:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:51:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-0e09d978-60b8-45fe-ba20-bcb5058b70e1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047999 Nov 14 02:51:15 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 432/1295] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:51:15 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=4 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:05 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:52:05 user devstack@n-api.service[64866]: Tue Nov 14 02:52:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments (ip 10.0.0.210) !!! Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:05 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:05 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-abb20ddd-5973-426e-8ede-53dba72cc512 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060238 Nov 14 02:52:05 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 429/1296] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:52:05 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac551123-c7fc-4818-a6fa-3d5ab8c12c31"}} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:07 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320457 Nov 14 02:52:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 436/1297] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:52:07 2023] POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:15 user devstack@n-api.service[64868]: DEBUG nova.objects.instance [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'services' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=64868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:52:15 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/ac551123-c7fc-4818-a6fa-3d5ab8c12c31" status: 202 len: 0 microversion: 2.1 time: 0.168580 Nov 14 02:52:15 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 433/1298] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:52:15 2023] DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/ac551123-c7fc-4818-a6fa-3d5ab8c12c31 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:52:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:52:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-00afc562-8795-440c-8875-91fc7785b0b4 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049520 Nov 14 02:52:15 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 430/1299] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:52:15 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:05 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:05 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-4a847c87-b9cf-4f5b-abc8-781691f6bf0d tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054911 Nov 14 02:53:05 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 437/1300] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:53:05 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06e9a2ba-7ae9-427c-a96b-d58138eede47"}} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:07 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:07 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278317 Nov 14 02:53:07 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 434/1301] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:53:07 2023] POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:15 user devstack@n-api.service[64866]: DEBUG nova.objects.instance [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'services' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=64866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:53:15 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/06e9a2ba-7ae9-427c-a96b-d58138eede47" status: 202 len: 0 microversion: 2.1 time: 0.167819 Nov 14 02:53:15 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 431/1302] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:53:15 2023] DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/06e9a2ba-7ae9-427c-a96b-d58138eede47 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:53:15 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:53:16 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-9d7808f4-631c-4016-b9a0-9dad742a85e9 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052259 Nov 14 02:53:16 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 438/1303] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:53:15 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:06 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:06 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-bd36eb47-ba7f-4fc9-8d74-d22ad99cfd02 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147280 Nov 14 02:54:06 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 435/1304] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:54:06 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "383c4a34-db76-48e2-843a-7fac96796096"}} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:08 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439816 Nov 14 02:54:08 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 432/1305] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 14 02:54:07 2023] POST /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:54:16 user devstack@n-api.service[64867]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=6 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:16 user devstack@n-api.service[64867]: DEBUG nova.objects.instance [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'services' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=64867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 14 02:54:16 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/383c4a34-db76-48e2-843a-7fac96796096" status: 202 len: 0 microversion: 2.1 time: 0.214782 Nov 14 02:54:16 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 439/1306] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 14 02:54:16 2023] DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments/383c4a34-db76-48e2-843a-7fac96796096 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:54:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:54:16 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-89b29411-ff8c-4cd3-8199-16c994e8939e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Nov 14 02:54:16 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 436/1307] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:54:16 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:06 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:55:06 user devstack@n-api.service[64866]: Tue Nov 14 02:55:06 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments (ip 10.0.0.210) !!! Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:06 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:06 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-69d432bc-37a0-4ab4-b37b-fdc7243422da tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056448 Nov 14 02:55:06 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 433/1308] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 14 02:55:06 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=2 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64867) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:16 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] [98bef958-7b37-4b92-95bf-87b942e439aa] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60000. Nov 14 02:55:16 user devstack@n-api.service[64867]: DEBUG nova.compute.api [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Going to try to terminate instance {{(pid=64867) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 14 02:55:16 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25" status: 204 len: 0 microversion: 2.1 time: 0.138158 Nov 14 02:55:16 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 440/1309] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 14 02:55:16 2023] DELETE /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG nova.compute.api [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64868) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:55:16 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:55:16 user devstack@n-api.service[64868]: Tue Nov 14 02:55:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 (ip 10.0.0.210) !!! Nov 14 02:55:16 user devstack@n-api.service[64868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:55:16 user devstack@n-api.service[64868]: Tue Nov 14 02:55:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 (ip 10.0.0.210) !!! Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_api:SELECT=2 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG dbcounter [-] [64868] Writing DB stats nova_cell1:SELECT=6 {{(pid=64868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:16 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:16 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:16 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=6 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:55:17 user devstack@n-api.service[64868]: DEBUG nova.policy [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bd8164c6734205b8e41e74b0ce832e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d92f0c85bd4b20a76d315b1fff8f81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64868) authorize /opt/stack/nova/nova/policy.py:203}} Nov 14 02:55:17 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f5ddb7-07d4-46a4-8428-6558a0ffcc25", "name": "network-vif-unplugged", "status": "completed", "tag": "10c48d81-cc93-41f7-93b5-8ec30223a387"}]} {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:55:17 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [None req-646debea-3347-43a9-9cda-c7ad1e55e567 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25" status: 200 len: 1719 microversion: 2.1 time: 0.313313 Nov 14 02:55:17 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 437/1310] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:55:16 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 => generated 1719 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 14 02:55:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:17 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.compute.server_external_events [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Creating event network-vif-unplugged:10c48d81-cc93-41f7-93b5-8ec30223a387 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 on user Nov 14 02:55:17 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106717 Nov 14 02:55:17 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 434/1311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:55:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:55:18 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [req-ce89bfa4-e0fe-4cc1-a6c2-023622473efa req-b9dd69f4-9bc7-4b68-a47b-b625497e1831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f5ddb7-07d4-46a4-8428-6558a0ffcc25", "name": "network-vif-deleted", "tag": "10c48d81-cc93-41f7-93b5-8ec30223a387"}]} {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:55:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ce89bfa4-e0fe-4cc1-a6c2-023622473efa req-b9dd69f4-9bc7-4b68-a47b-b625497e1831 service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ce89bfa4-e0fe-4cc1-a6c2-023622473efa req-b9dd69f4-9bc7-4b68-a47b-b625497e1831 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:18 user devstack@n-api.service[64867]: DEBUG oslo_concurrency.lockutils [req-ce89bfa4-e0fe-4cc1-a6c2-023622473efa req-b9dd69f4-9bc7-4b68-a47b-b625497e1831 service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64867) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.compute.server_external_events [req-ce89bfa4-e0fe-4cc1-a6c2-023622473efa req-b9dd69f4-9bc7-4b68-a47b-b625497e1831 service nova] Creating event network-vif-deleted:10c48d81-cc93-41f7-93b5-8ec30223a387 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 on user Nov 14 02:55:18 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [req-ce89bfa4-e0fe-4cc1-a6c2-023622473efa req-b9dd69f4-9bc7-4b68-a47b-b625497e1831 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094174 Nov 14 02:55:18 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 441/1312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:55:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:55:19 user devstack@n-api.service[64868]: DEBUG nova.api.openstack.wsgi [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f5ddb7-07d4-46a4-8428-6558a0ffcc25", "name": "network-vif-plugged", "status": "completed", "tag": "10c48d81-cc93-41f7-93b5-8ec30223a387"}]} {{(pid=64868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 14 02:55:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:55:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:55:19 user devstack@n-api.service[64868]: DEBUG oslo_concurrency.lockutils [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64868) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:55:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.compute.server_external_events [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Creating event network-vif-plugged:10c48d81-cc93-41f7-93b5-8ec30223a387 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 on user Nov 14 02:55:19 user devstack@n-api.service[64868]: INFO nova.api.openstack.requestlog [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035442 Nov 14 02:55:19 user devstack@n-api.service[64868]: [pid: 64868|app: 0|req: 438/1313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 14 02:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 14 02:56:07 user devstack@n-api.service[64866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:56:07 user devstack@n-api.service[64866]: Tue Nov 14 02:56:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 (ip 10.0.0.210) !!! Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_api:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG dbcounter [-] [64866] Writing DB stats nova_cell1:SELECT=2 {{(pid=64866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '>' {{(pid=64866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG nova.compute.api [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Fetching instance by UUID {{(pid=64866) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG oslo_concurrency.lockutils [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ff922a0f-fbdc-4dd7-ba91-19419fe3fa47" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64866) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 14 02:56:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.wsgi [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] HTTP exception thrown: Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 could not be found. Nov 14 02:56:07 user devstack@n-api.service[64866]: DEBUG nova.api.openstack.wsgi [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Returning 404 to user: Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 could not be found. {{(pid=64866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 14 02:56:07 user devstack@n-api.service[64866]: INFO nova.api.openstack.requestlog [None req-6df8fddf-2783-4872-8cdc-8c7d12c79451 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25" status: 404 len: 111 microversion: 2.1 time: 0.039644 Nov 14 02:56:07 user devstack@n-api.service[64866]: [pid: 64866|app: 0|req: 435/1314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 14 02:56:07 2023] GET /compute/v2.1/servers/50f5ddb7-07d4-46a4-8428-6558a0ffcc25 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 14 02:56:07 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:56:07 user devstack@n-api.service[64867]: DEBUG dbcounter [-] [64867] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64867) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 14 02:56:07 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:56:07 user devstack@n-api.service[64867]: Tue Nov 14 02:56:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1667210968 (ip 10.0.0.210) !!! Nov 14 02:56:07 user devstack@n-api.service[64867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 14 02:56:07 user devstack@n-api.service[64867]: Tue Nov 14 02:56:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1667210968 (ip 10.0.0.210) !!! Nov 14 02:56:07 user devstack@n-api.service[64867]: DEBUG nova.api.openstack.wsgi [None req-4c951be6-0ead-44b2-86db-123102552043 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Calling method '.version_select at 0x7fc9eae21a20>' {{(pid=64867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 14 02:56:07 user devstack@n-api.service[64867]: INFO nova.api.openstack.requestlog [None req-4c951be6-0ead-44b2-86db-123102552043 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667210968" status: 202 len: 0 microversion: 2.1 time: 0.052299 Nov 14 02:56:07 user devstack@n-api.service[64867]: [pid: 64867|app: 0|req: 442/1315] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 14 02:56:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667210968 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)